Jul 30 16:28:39 devstack cinder-volume[77265]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:28:39 devstack cinder-volume[77265]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:28:39 devstack cinder-volume[77265]: we strongly recommend against using it for new projects. Jul 30 16:28:39 devstack cinder-volume[77265]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:28:39 devstack cinder-volume[77265]: framework. For more detail see Jul 30 16:28:39 devstack cinder-volume[77265]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:28:39 devstack cinder-volume[77265]: import eventlet # noqa Jul 30 16:28:42 devstack cinder-volume[77265]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:28:42 devstack cinder-volume[77265]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:28:42 devstack cinder-volume[77265]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:28:43 devstack cinder-volume[77265]: INFO dbcounter [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Registered counter for database cinder Jul 30 16:28:43 devstack cinder-volume[77265]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:28:43 devstack cinder-volume[77265]: DEBUG dbcounter [-] [77265] Writer thread running {{(pid=77265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:28:43 devstack cinder-volume[77265]: INFO cinder.rpc [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:28:43 devstack cinder-volume[77265]: INFO cinder.rpc [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:28:43 devstack cinder-volume[77265]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:28:43 devstack cinder-volume[77265]: INFO cinder.volume.manager [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Determined volume DB was empty at startup. Jul 30 16:28:43 devstack cinder-volume[77265]: DEBUG cinder.volume.manager [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77265) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:28:43 devstack cinder-volume[77265]: INFO cinder.volume.manager [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:28:43 devstack cinder-volume[77265]: WARNING stevedore.named [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:28:43 devstack cinder-volume[77265]: WARNING castellan.key_manager [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:28:43 devstack cinder-volume[77265]: WARNING cinder.keymgr.conf_key_mgr [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:28:43 devstack cinder-volume[77265]: DEBUG cinder.volume.drivers.lvm [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77265) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 30 16:28:43 devstack cinder-volume[77265]: DEBUG oslo_concurrency.processutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_concurrency.processutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] CMD "cinder-rtstool verify" returned: 0 in 0.423s {{(pid=77265) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:28:44 devstack cinder-volume[77265]: INFO cinder.rpc [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 30 16:28:44 devstack cinder-volume[77265]: INFO cinder.rpc [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 30 16:28:44 devstack cinder-volume[77265]: WARNING stevedore.named [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:28:44 devstack cinder-volume[77265]: WARNING castellan.key_manager [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:28:44 devstack cinder-volume[77265]: INFO cinder.volume.manager [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:28:44 devstack cinder-volume[77265]: INFO oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Starting 1 workers Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Started child 77418 {{(pid=77265) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Full set of CONF: {{(pid=77265) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] ******************************************************************************** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Configuration options gathered from: {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] ================================================================================ {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] allow_availability_zone_fallback = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] allow_compression_on_image_upload = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] allowed_direct_url_schemes = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] api_rate_limit = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] auth_strategy = keystone {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] az_cache_duration = 3600 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_availability_zone = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_host = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_stats_polling_interval = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backup_api_class = cinder.backup.api.API {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77418]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backup_name_template = backup-%s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backup_use_same_host = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backup_use_temp_snapshot = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] chap_password = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] chap_username = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_internal_tenant_project_id = ac3f81b7b0934309a941613ee6a07f68 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_internal_tenant_user_id = 781c158b2e594ee6b44933c7dbd5591f {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cloned_volume_same_az = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cluster = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] compression_format = gzip {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] compute_api_class = cinder.compute.nova.API {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] config_dir = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] config_source = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] control_exchange = openstack {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] debug = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] default_availability_zone = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] default_group_type = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] default_volume_type = lvmdriver-1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] disk_geometry = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] driver_client_cert = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] driver_client_cert_key = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] driver_data_namespace = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] driver_ssl_cert_path = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] driver_ssl_cert_verify = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] driver_use_ssl = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] enable_force_upload = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] enable_new_services = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] enable_unsupported_driver = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] enforce_multipath_for_image_xfer = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] filter_function = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_api_insecure = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_api_servers = ['http://192.168.122.63/image'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_api_ssl_compression = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_ca_certificates_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_catalog_info = image:glance:publicURL {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_num_retries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance_request_timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] goodness_function = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] graceful_shutdown_timeout = 5 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] group_api_class = cinder.group.api.API {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] host = devstack {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_compress_on_upload = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_conversion_address_space_limit = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_conversion_cpu_limit = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_conversion_disable = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_upload_use_cinder_backend = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_upload_use_internal_tenant = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_volume_cache_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_volume_cache_max_count = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] image_volume_cache_max_size_gb = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] init_host_max_objects_retrieval = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] instance_format = [instance: %(uuid)s] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] iscsi_target_flags = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] iscsi_write_cache = on {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] iser_helper = tgtadm {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] iser_ip_address = 192.168.122.63 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] iser_port = 3260 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_color = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_config_append = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_dir = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_options = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_rotate_interval = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_rotate_interval_type = days {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] log_rotation_type = none {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] max_age = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] max_logfile_count = 30 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] max_logfile_size_mb = 200 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] max_over_subscription_ratio = 20.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] message_reap_interval = 86400 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] message_ttl = 2592000 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] migration_create_volume_timeout_secs = 300 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] monkey_patch = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] monkey_patch_modules = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] my_ip = 192.168.122.63 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] no_snapshot_gb_quota = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] num_iser_scan_tries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] num_shell_tries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] num_volume_device_scan_tries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] nvmeof_conn_info_version = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] nvmet_ns_id = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] nvmet_port_id = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_max_limit = 1000 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_volume_ext_list = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_volume_listen_port = 8776 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_volume_use_ssl = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] osapi_volume_workers = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] per_volume_size_limit = -1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] periodic_fuzzy_delay = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] periodic_interval = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] public_endpoint = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] publish_errors = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_backup_gigabytes = 1000 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77418]: INFO cinder.volume.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_backups = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_gigabytes = 1000 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_groups = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_snapshots = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] quota_volumes = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] rate_limit_burst = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] rate_limit_except_level = CRITICAL {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] rate_limit_interval = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] reinit_driver_count = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] replication_device = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] report_discard_supported = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] report_interval = 120 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] reservation_clean_interval = 86400 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] reservation_expire = 86400 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] reserved_image_namespaces = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] reserved_percentage = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] rpc_response_timeout = 120 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] run_external_periodic_tasks = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] scst_target_driver = iscsi {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] scst_target_iqn_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_down_time = 720 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] shell_completion = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] snapshot_name_template = snapshot-%s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] snapshot_same_host = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] split_loggers = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] state_path = /opt/stack/data/cinder {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] storage_availability_zone = nova {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] storage_protocol = iSCSI {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] syslog_log_facility = LOG_USER {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] target_helper = lioadm {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] target_ip_address = 192.168.122.63 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] target_port = 3260 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] target_protocol = iscsi {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] target_secondary_ip_addresses = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] trace_flags = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] transport_url = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] until_refresh = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_chap_auth = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_default_quota_class = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_journal = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_json = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_multipath_for_image_xfer = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_stderr = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] use_syslog = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] verify_glance_signatures = enabled {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_api_class = cinder.volume.api.API {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_backend_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_clear = zero {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_clear_ionice = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_clear_size = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_copy_bps_limit = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_dd_blocksize = 1M {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_name_template = volume-%s {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_service_inithost_offload = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volume_usage_audit_period = month {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] zoning_mode = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_concurrency.disable_process_locking = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.auth_section = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.auth_type = password {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.auth_version = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.cache = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.include_service_catalog = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.insecure = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.interface = public {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_password = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcache_username = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.region_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.service_type = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.63/identity {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.backend = dogpile.cache.null {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.backend_argument = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.backend_expiration_time = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.config_prefix = cache.oslo {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.debug_cache_backend = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.enable_retry_client = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.enable_socket_keepalive = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.expiration_time = 600 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.hashclient_retry_attempts = 2 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_dead_retry = 300 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_pool_maxsize = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_sasl_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.password = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.proxies = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.redis_db = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.redis_server = localhost:6379 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.retry_attempts = 2 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.retry_delay = 0.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.socket_keepalive_count = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.socket_keepalive_idle = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.socket_keepalive_interval = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.socket_timeout = 1.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.tls_allowed_ciphers = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.tls_cafile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.tls_certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.tls_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.tls_keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cache.username = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] coordination.backend_url = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.asyncio_connection = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.asyncio_slave_connection = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.backend = sqlalchemy {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.connection = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.connection_debug = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.connection_parameters = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.connection_recycle_time = 3600 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.connection_trace = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.db_inc_retry_interval = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.db_max_retries = 20 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.db_max_retry_interval = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.db_retry_interval = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.max_overflow = 50 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.max_pool_size = 5 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.max_retries = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.mysql_wsrep_sync_wait = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.pool_timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.retry_interval = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.slave_connection = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.sqlite_synchronous = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.synchronous_reader = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] database.use_db_reconnect = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.connection_string = messaging:// {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.es_doc_type = notification {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.es_scroll_size = 10000 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.es_scroll_time = 2m {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.filter_error_trace = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.hmac_keys = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.sentinel_service_name = mymaster {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.socket_timeout = 0.1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.trace_requests = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler.trace_sqlalchemy = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler_jaeger.process_tags = {} {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler_jaeger.service_name_prefix = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] profiler_otlp.service_name_prefix = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.enforce_new_defaults = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.policy_default_rule = default {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.policy_file = policy.yaml {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.group = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.helper_command = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] privsep_osbrick.user = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.group = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.helper_command = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] cinder_sys_admin.user = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.auth_section = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.auth_type = password {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.cafile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.collect_timing = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.insecure = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.send_service_user_token = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.split_loggers = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] service_user.timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.auth_section = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.auth_type = password {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.collect_timing = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.insecure = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.region_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.split_loggers = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] glance.timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.backend_availability_zone = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.chap_password = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.chap_username = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.disk_geometry = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.driver_client_cert = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.driver_client_cert_key = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.driver_data_namespace = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.driver_use_ssl = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.extra_capabilities = {} {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.filter_function = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.goodness_function = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.iscsi_target_flags = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.iscsi_write_cache = on {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.iser_helper = tgtadm {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.iser_ip_address = 192.168.122.63 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.iser_port = 3260 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.lvm_share_target = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.lvm_type = auto {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.num_shell_tries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.replication_device = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.report_discard_supported = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.reserved_percentage = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.target_helper = tgtadm {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.target_ip_address = 192.168.122.63 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.target_port = 3260 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.target_protocol = iscsi {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack sudo[77422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.trace_flags = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.unique_fqdn_network = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.use_chap_auth = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_backend_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_clear = zero {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_clear_ionice = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack sudo[77422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_clear_size = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_reports.file_event_handler = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_reports.log_dir = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.backend_host = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.chap_password = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.chap_username = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.disk_geometry = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.driver_client_cert = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.extra_capabilities = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.filter_function = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.goodness_function = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.iser_helper = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.iser_ip_address = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.iser_port = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.lvm_share_target = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.lvm_type = auto {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.num_shell_tries = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.replication_device = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.report_discard_supported = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.reserved_percentage = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.scst_target_driver = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.storage_protocol = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.target_helper = lioadm {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.target_ip_address = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.target_port = 3260 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.trace_flags = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.use_chap_auth = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_clear = zero {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_clear_size = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] lvmdriver-1.volumes_dir = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_notifications.driver = [] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_notifications.retry = -1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] key_manager.fixed_key = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.barbican_api_version = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.barbican_endpoint = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.barbican_endpoint_type = public {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.barbican_region_name = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.cafile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.collect_timing = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.insecure = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.number_of_retries = 60 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.retry_delay = 1 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.send_service_user_token = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.split_loggers = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.verify_ssl = True {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican.verify_ssl_path = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.auth_section = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.auth_type = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.cafile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.certfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.collect_timing = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.insecure = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.keyfile = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.split_loggers = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] barbican_service_user.timeout = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.approle_role_id = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.approle_secret_id = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.auth_method = approle {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.auth_path = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.kv_mountpoint = secret {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.kv_path = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.kv_version = 2 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.namespace = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.root_token_id = **** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.ssl_ca_crt_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.timeout = 60.0 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.token_file = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.token_role = None {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:44 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.use_ssl = False {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:45 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:28:45 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] ******************************************************************************** {{(pid=77265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:28:45 devstack sudo[77422]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.404s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:45 devstack sudo[77426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:45 devstack sudo[77426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:45 devstack sudo[77426]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.307s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:28:45 devstack cinder-volume[77418]: INFO cinder.brick.local_dev.lvm [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:45 devstack sudo[77522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:28:45 devstack sudo[77522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:45 devstack sudo[77522]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG cinder.brick.local_dev.lvm [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77418) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 30 16:28:45 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:45 devstack sudo[77614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:45 devstack sudo[77614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:46 devstack sudo[77614]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:46 devstack sudo[77800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:46 devstack sudo[77800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:46 devstack sudo[77800]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:46 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:46 devstack sudo[77889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 30 16:28:46 devstack sudo[77889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:47 devstack sudo[77889]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:47 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.258s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:47 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:47 devstack sudo[77961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:28:47 devstack sudo[77961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:47 devstack sudo[77961]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:47 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:47 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:47 devstack sudo[78039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:28:47 devstack sudo[78039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:47 devstack sudo[78039]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:47 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:47 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:47 devstack sudo[78082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:47 devstack sudo[78082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:48 devstack sudo[78082]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.541s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:48 devstack sudo[78180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:48 devstack sudo[78180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:48 devstack sudo[78180]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:48 devstack sudo[78223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:48 devstack sudo[78223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:48 devstack sudo[78223]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.368s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:48 devstack cinder-volume[77418]: INFO cinder.volume.drivers.lvm [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:48 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:48 devstack sudo[78277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:48 devstack sudo[78277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:49 devstack sudo[78277]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:49 devstack sudo[78296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:28:49 devstack sudo[78296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:49 devstack sudo[78296]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:49 devstack sudo[78299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:49 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:49 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:49 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:49 devstack sudo[78302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:49 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:50 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:50 devstack sudo[78306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:50 devstack sudo[78306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:50 devstack sudo[78306]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:50 devstack cinder-volume[77418]: INFO cinder.volume.driver [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG cinder.volume.driver [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77418) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_db.sqlalchemy.engines [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77418) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG dbcounter [-] [77418] Writer thread running {{(pid=77418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG cinder.db.api [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Building query based on filter {{(pid=77418) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG cinder.image.image_utils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77418) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:28:50 devstack cinder-volume[77418]: INFO cinder.keymgr.migration [None req-f93e075e-f266-47eb-88fd-cd312a409600 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:50 devstack sudo[78310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:28:50 devstack sudo[78310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:50 devstack sudo[78310]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:50 devstack sudo[78313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:50 devstack sudo[78313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:50 devstack sudo[78313]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:50 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:50 devstack sudo[78318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:50 devstack sudo[78318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:51 devstack sudo[78318]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:51 devstack sudo[78322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:51 devstack sudo[78322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:51 devstack sudo[78322]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG cinder.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Notifying Schedulers of capabilities ... {{(pid=77418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:28:51 devstack cinder-volume[77418]: INFO cinder.volume.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Driver initialization completed successfully. Jul 30 16:28:51 devstack cinder-volume[77418]: INFO cinder.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Initiating service 2 cleanup Jul 30 16:28:51 devstack cinder-volume[77418]: INFO cinder.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Service 2 cleanup completed. Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG cinder.service [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Creating RPC server for service cinder-volume {{(pid=77418) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG cinder.service [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77418) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:28:51 devstack cinder-volume[77418]: INFO cinder.volume.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:28:51 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:51 devstack sudo[78326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:28:51 devstack sudo[78326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:52 devstack sudo[78326]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:52 devstack sudo[78330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:52 devstack sudo[78330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:52 devstack sudo[78330]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:52 devstack sudo[78333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:28:52 devstack sudo[78333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:52 devstack sudo[78333]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:28:52 devstack sudo[78336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:28:52 devstack sudo[78336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:28:52 devstack sudo[78336]: pam_unix(sudo:session): session closed for user root Jul 30 16:28:52 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:28:52 devstack cinder-volume[77418]: INFO cinder.volume.manager [None req-2e486a87-a226-4645-ba14-4a24216d17f6 None None] Driver post RPC initialization completed successfully. Jul 30 16:28:54 devstack cinder-volume[77265]: DEBUG dbcounter [-] [77265] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:28:56 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager._thread_info {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:28:56 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread count: 6 {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:28:56 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread info: [<_MainThread(MainThread, started 135388008415360)>, , , , , ] {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:29:01 devstack cinder-volume[77418]: DEBUG dbcounter [-] [77418] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:29:02 devstack cinder-volume[77418]: DEBUG dbcounter [-] [77418] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:29:56 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:29:56 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:29:56 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:56 devstack sudo[80389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:29:56 devstack sudo[80389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[80389]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:57 devstack sudo[80392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:29:57 devstack sudo[80392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[80392]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:57 devstack sudo[80395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:29:57 devstack sudo[80395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[80395]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:29:57 devstack sudo[80398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:29:57 devstack sudo[80398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:29:57 devstack sudo[80398]: pam_unix(sudo:session): session closed for user root Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG cinder.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Notifying Schedulers of capabilities ... {{(pid=77418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager._thread_info {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread count: 6 {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:29:57 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread info: [<_MainThread(MainThread, started 135388008415360)>, , , , , ] {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:30:56 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:30:56 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:30:56 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:56 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:30:56 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:57 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:57 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:30:57 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:57 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:57 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:30:57 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:57 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:30:57 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:30:57 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:30:57 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:30:57 devstack cinder-volume[77418]: DEBUG cinder.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Notifying Schedulers of capabilities ... {{(pid=77418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:02 devstack cinder-volume[77418]: DEBUG dbcounter [-] [77418] Writing DB stats cinder:SELECT=1 {{(pid=77418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:31:02 devstack cinder-volume[77418]: DEBUG dbcounter [-] [77418] Writing DB stats cinder:UPDATE=1 {{(pid=77418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:31:56 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:31:56 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:31:56 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:56 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:31:56 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:57 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:57 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:31:57 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:57 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:57 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:31:57 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:57 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:31:57 devstack sudo[85826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:31:57 devstack sudo[85826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:31:57 devstack sudo[85826]: pam_unix(sudo:session): session closed for user root Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG cinder.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Notifying Schedulers of capabilities ... {{(pid=77418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager._thread_info {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread count: 6 {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:31:57 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread info: [<_MainThread(MainThread, started 135388008415360)>, , , , , ] {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:32:56 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:32:56 devstack cinder-volume[77418]: DEBUG cinder.volume.drivers.lvm [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Updating volume stats {{(pid=77418) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 30 16:32:56 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:56 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 30 16:32:56 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:57 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:57 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:32:57 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:57 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:57 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 30 16:32:57 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:57 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:32:57 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 30 16:32:57 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:32:57 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_concurrency.processutils [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77418) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG cinder.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Notifying Schedulers of capabilities ... {{(pid=77418) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG oslo_service.periodic_task [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] Running periodic task VolumeManager._thread_info {{(pid=77418) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread count: 6 {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:32:57 devstack cinder-volume[77418]: DEBUG cinder.volume.manager [None req-e1bc2f0c-48b8-4cdc-ae07-b12653754607 None None] thread info: [<_MainThread(MainThread, started 135388008415360)>, , , , , ] {{(pid=77418) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:33:02 devstack cinder-volume[77418]: DEBUG dbcounter [-] [77418] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77418) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:33:15 devstack cinder-volume[77265]: INFO oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Caught SIGTERM, stopping children Jul 30 16:33:15 devstack cinder-volume[77265]: DEBUG oslo_concurrency.lockutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Acquiring lock "singleton_lock" {{(pid=77265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:33:15 devstack cinder-volume[77265]: DEBUG oslo_concurrency.lockutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Acquired lock "singleton_lock" {{(pid=77265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:33:15 devstack cinder-volume[77265]: DEBUG oslo_concurrency.lockutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Releasing lock "singleton_lock" {{(pid=77265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:33:15 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Stop services. {{(pid=77265) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:33:15 devstack cinder-volume[77265]: DEBUG oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Killing children. {{(pid=77265) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:33:15 devstack cinder-volume[77265]: INFO oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Waiting on 1 children to exit Jul 30 16:33:16 devstack cinder-volume[77418]: DEBUG oslo_concurrency.lockutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Acquiring lock "singleton_lock" {{(pid=77418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:33:16 devstack cinder-volume[77418]: DEBUG oslo_concurrency.lockutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Acquired lock "singleton_lock" {{(pid=77418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:33:16 devstack cinder-volume[77418]: DEBUG oslo_concurrency.lockutils [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Releasing lock "singleton_lock" {{(pid=77418) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:33:16 devstack cinder-volume[77418]: WARNING amqp [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:33:16 devstack cinder-volume[77418]: WARNING amqp [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:33:16 devstack cinder-volume[77265]: INFO oslo_service.backend._eventlet.service [None req-3c9adb02-12a6-43fc-8fbc-005848809890 None None] Child 77418 exited with status 0 Jul 30 16:33:17 devstack cinder-volume[87579]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:33:17 devstack cinder-volume[87579]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:33:17 devstack cinder-volume[87579]: we strongly recommend against using it for new projects. Jul 30 16:33:17 devstack cinder-volume[87579]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:33:17 devstack cinder-volume[87579]: framework. For more detail see Jul 30 16:33:17 devstack cinder-volume[87579]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:33:17 devstack cinder-volume[87579]: import eventlet # noqa Jul 30 16:33:19 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:33:19 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:33:19 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:33:19 devstack cinder-volume[87579]: INFO dbcounter [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Registered counter for database cinder Jul 30 16:33:19 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG dbcounter [-] [87579] Writer thread running {{(pid=87579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:33:20 devstack cinder-volume[87579]: INFO cinder.rpc [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:33:20 devstack cinder-volume[87579]: INFO cinder.rpc [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:20 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Determined volume DB was empty at startup. Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG cinder.volume.manager [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87579) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:33:20 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 30 16:33:20 devstack cinder-volume[87579]: WARNING stevedore.named [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:33:20 devstack cinder-volume[87579]: WARNING castellan.key_manager [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:33:20 devstack cinder-volume[87579]: WARNING cinder.keymgr.conf_key_mgr [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:33:20 devstack cinder-volume[87579]: INFO cinder.volume.manager [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_db.sqlalchemy.engines [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:20 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Starting 1 workers Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Started child 87794 {{(pid=87579) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Full set of CONF: {{(pid=87579) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] ******************************************************************************** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Configuration options gathered from: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] ================================================================================ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] allow_availability_zone_fallback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] allow_compression_on_image_upload = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87794]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] allowed_direct_url_schemes = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] api_rate_limit = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] auth_strategy = keystone {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_host = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_stats_polling_interval = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backup_api_class = cinder.backup.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backup_name_template = backup-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backup_use_same_host = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backup_use_temp_snapshot = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] chap_username = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_internal_tenant_project_id = ac3f81b7b0934309a941613ee6a07f68 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_internal_tenant_user_id = 781c158b2e594ee6b44933c7dbd5591f {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cluster = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] compression_format = gzip {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] compute_api_class = cinder.compute.nova.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] config_dir = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] config_source = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] control_exchange = openstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] debug = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] default_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] default_group_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] default_volume_type = QuobyteHD {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] driver_ssl_cert_verify = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] driver_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] enable_new_services = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] enable_unsupported_driver = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] enabled_backends = ['QuobyteHD'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] enforce_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_api_insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_api_servers = ['http://192.168.122.63/image'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_api_ssl_compression = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_ca_certificates_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_catalog_info = image:glance:publicURL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_num_retries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance_request_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] graceful_shutdown_timeout = 5 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] group_api_class = cinder.group.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] host = devstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_compress_on_upload = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_conversion_address_space_limit = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_conversion_cpu_limit = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_conversion_disable = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_upload_use_cinder_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_upload_use_internal_tenant = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_volume_cache_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_volume_cache_max_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] image_volume_cache_max_size_gb = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] init_host_max_objects_retrieval = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] instance_format = [instance: %(uuid)s] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] iscsi_target_flags = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] iscsi_write_cache = on {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] iser_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] iser_ip_address = 192.168.122.63 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] iser_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_color = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_config_append = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_dir = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_options = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_rotate_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_rotate_interval_type = days {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] log_rotation_type = none {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] max_age = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] max_logfile_count = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] max_logfile_size_mb = 200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] max_over_subscription_ratio = 20.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] message_reap_interval = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] message_ttl = 2592000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] migration_create_volume_timeout_secs = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] monkey_patch = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] monkey_patch_modules = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] my_ip = 192.168.122.63 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] no_snapshot_gb_quota = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] num_iser_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] num_shell_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] num_volume_device_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] nvmeof_conn_info_version = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] nvmet_ns_id = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] nvmet_port_id = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_max_limit = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_volume_ext_list = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_volume_listen_port = 8776 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_volume_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] osapi_volume_workers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] per_volume_size_limit = -1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] periodic_fuzzy_delay = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] periodic_interval = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] public_endpoint = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] publish_errors = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_backup_gigabytes = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_backups = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_gigabytes = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_groups = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_snapshots = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] quota_volumes = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] rate_limit_burst = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] rate_limit_except_level = CRITICAL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] rate_limit_interval = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] reinit_driver_count = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] report_discard_supported = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] report_interval = 120 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] reservation_clean_interval = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] reservation_expire = 86400 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] reserved_image_namespaces = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] reserved_percentage = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] rpc_response_timeout = 120 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] run_external_periodic_tasks = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] scst_target_driver = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_down_time = 720 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] shell_completion = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] snapshot_name_template = snapshot-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] state_path = /opt/stack/data/cinder {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] storage_availability_zone = nova {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] storage_protocol = iSCSI {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] syslog_log_facility = LOG_USER {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] target_helper = lioadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] target_ip_address = 192.168.122.63 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] target_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] target_protocol = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] target_secondary_ip_addresses = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] trace_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] transport_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] until_refresh = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_chap_auth = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_default_quota_class = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_journal = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_json = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_stderr = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] use_syslog = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] verify_glance_signatures = enabled {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_api_class = cinder.volume.api.API {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_clear = zero {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_clear_size = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_copy_bps_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_dd_blocksize = 1M {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_name_template = volume-%s {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_service_inithost_offload = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volume_usage_audit_period = month {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] zoning_mode = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_concurrency.disable_process_locking = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.auth_type = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.auth_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.include_service_catalog = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.interface = public {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_password = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87794]: INFO cinder.volume.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.remotefs [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87794) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcache_username = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.service_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.63/identity {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.backend = dogpile.cache.null {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.backend_argument = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.backend_expiration_time = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.config_prefix = cache.oslo {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.debug_cache_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.enable_retry_client = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.enable_socket_keepalive = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.expiration_time = 600 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.hashclient_retry_attempts = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_dead_retry = 300 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_pool_maxsize = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_sasl_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.proxies = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.redis_db = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.redis_server = localhost:6379 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.retry_attempts = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.retry_delay = 0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.socket_keepalive_count = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.socket_keepalive_idle = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.socket_keepalive_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.socket_timeout = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.tls_allowed_ciphers = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.tls_cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.tls_certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.tls_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.tls_keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cache.username = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] coordination.backend_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.asyncio_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.asyncio_slave_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.backend = sqlalchemy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.connection_debug = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.connection_parameters = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.connection_recycle_time = 3600 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.connection_trace = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.db_inc_retry_interval = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.db_max_retries = 20 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.db_max_retry_interval = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.db_retry_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.max_overflow = 50 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.max_pool_size = 5 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.max_retries = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.mysql_wsrep_sync_wait = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.pool_timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.retry_interval = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.slave_connection = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.sqlite_synchronous = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.synchronous_reader = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] database.use_db_reconnect = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.connection_string = messaging:// {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.es_doc_type = notification {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.es_scroll_size = 10000 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.es_scroll_time = 2m {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.filter_error_trace = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.hmac_keys = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.sentinel_service_name = mymaster {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.socket_timeout = 0.1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.trace_requests = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler.trace_sqlalchemy = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler_jaeger.process_tags = {} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler_jaeger.service_name_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] profiler_otlp.service_name_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.enforce_new_defaults = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.policy_default_rule = default {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.policy_file = policy.yaml {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.group = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.helper_command = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] privsep_osbrick.user = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.group = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.helper_command = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] cinder_sys_admin.user = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.auth_type = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.send_service_user_token = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] service_user.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.auth_type = password {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] glance.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.chap_username = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.driver_use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.extra_capabilities = {} {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.iscsi_target_flags = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.iscsi_write_cache = on {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.iser_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.iser_ip_address = 192.168.122.63 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.iser_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_host = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_login = admin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_mount_options = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_private_key = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_share_path = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.num_shell_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.quobyte_volume_url = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.report_discard_supported = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.reserved_percentage = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.target_helper = tgtadm {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.target_ip_address = 192.168.122.63 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.target_port = 3260 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.target_protocol = iscsi {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.trace_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.unique_fqdn_network = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.use_chap_auth = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_backend_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_clear = zero {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_clear_size = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_reports.file_event_handler = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_reports.log_dir = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.backend_availability_zone = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.backend_host = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.chap_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.chap_username = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.chiscsi_conf = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.disk_geometry = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.driver_client_cert = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.driver_data_namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.driver_use_ssl = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.extra_capabilities = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.filter_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.goodness_function = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.iser_helper = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.iser_ip_address = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.iser_port = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.iser_target_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_host = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_login = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_mount_options = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_password = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_private_key = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_share_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_ssh_port = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.num_shell_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.nvmet_port_id = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.replication_device = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.report_discard_supported = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.reserved_percentage = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.scst_target_driver = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.storage_protocol = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.target_helper = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.target_ip_address = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.target_port = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.target_prefix = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.target_protocol = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.trace_flags = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.use_chap_auth = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_clear = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_clear_size = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] QuobyteHD.volumes_dir = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87794) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87794]: WARNING cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87794]: WARNING cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Running cmd (subprocess): mount.quobyte {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack quobyte-client[87799]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_notifications.driver = [] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_notifications.retry = -1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack quobyte-client[87799]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] key_manager.fixed_key = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.barbican_api_version = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.barbican_endpoint = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.barbican_endpoint_type = public {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.barbican_region_name = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.number_of_retries = 60 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.retry_delay = 1 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.send_service_user_token = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.verify_ssl = True {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican.verify_ssl_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.auth_section = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.auth_type = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.cafile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.certfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.collect_timing = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.insecure = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.keyfile = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.split_loggers = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] barbican_service_user.timeout = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.approle_role_id = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.approle_secret_id = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.auth_method = approle {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.auth_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.kv_mountpoint = secret {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.kv_path = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.kv_version = 2 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.namespace = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.root_token_id = **** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.ssl_ca_crt_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.timeout = 60.0 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.token_file = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.token_role = None {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.use_ssl = False {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:20 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] ******************************************************************************** {{(pid=87579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=87794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:20 devstack cinder-volume[87794]: INFO cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 ... Jul 30 16:33:20 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b -c /etc/quobyte/client-cinder.cfg {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:20 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b -c /etc/quobyte/client-cinder.cfg Jul 30 16:33:20 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:21 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.372s {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:21 devstack cinder-volume[87794]: INFO cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 succeeded Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=87794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.386s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:21 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:21 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:21 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.291s {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:21 devstack cinder-volume[87794]: INFO cinder.volume.driver [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG cinder.volume.driver [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.74658203125, 'free_capacity_gb': 1775.74658203125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87794) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_db.sqlalchemy.engines [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87794) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG dbcounter [-] [87794] Writer thread running {{(pid=87794) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG cinder.db.api [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Building query based on filter {{(pid=87794) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG cinder.image.image_utils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87794) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:33:21 devstack cinder-volume[87794]: INFO cinder.keymgr.migration [None req-eede80e2-a735-4073-8a01-a97a8ff536d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=87794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=87794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:21 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:21 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:21 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:22 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.295s {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG cinder.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Notifying Schedulers of capabilities ... {{(pid=87794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:22 devstack cinder-volume[87794]: INFO cinder.volume.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Driver initialization completed successfully. Jul 30 16:33:22 devstack cinder-volume[87794]: INFO cinder.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Initiating service 3 cleanup Jul 30 16:33:22 devstack cinder-volume[87794]: INFO cinder.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Service 3 cleanup completed. Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG cinder.service [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Creating RPC server for service cinder-volume {{(pid=87794) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG cinder.service [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87794) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:33:22 devstack cinder-volume[87794]: INFO cinder.volume.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=87794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=87794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:22 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:22 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:22 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:22 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.282s {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:22 devstack cinder-volume[87794]: INFO cinder.volume.manager [None req-6a050744-4d33-4aa1-ac7b-a55070d7607c None None] Driver post RPC initialization completed successfully. Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=87794) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG cinder.volume.drivers.quobyte [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=87794) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87794) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:26 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:26 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:26 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG oslo_concurrency.processutils [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.249s {{(pid=87794) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:26 devstack cinder-volume[87794]: DEBUG cinder.manager [None req-fb80210d-ccfc-4307-b2c6-904782c3d3d9 None None] Notifying Schedulers of capabilities ... {{(pid=87794) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:27 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Caught SIGTERM, stopping children Jul 30 16:33:27 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Acquiring lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:33:27 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Acquired lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:33:27 devstack cinder-volume[87579]: DEBUG oslo_concurrency.lockutils [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Releasing lock "singleton_lock" {{(pid=87579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:33:27 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Stop services. {{(pid=87579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 30 16:33:27 devstack cinder-volume[87579]: DEBUG oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Killing children. {{(pid=87579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 30 16:33:27 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Waiting on 1 children to exit Jul 30 16:33:30 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Acquiring lock "singleton_lock" {{(pid=87794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:33:30 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Acquired lock "singleton_lock" {{(pid=87794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:33:30 devstack cinder-volume[87794]: DEBUG oslo_concurrency.lockutils [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Releasing lock "singleton_lock" {{(pid=87794) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:33:30 devstack cinder-volume[87794]: WARNING amqp [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:33:30 devstack cinder-volume[87794]: WARNING amqp [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 30 16:33:30 devstack cinder-volume[87579]: INFO oslo_service.backend._eventlet.service [None req-af16f51f-46ee-4e68-8f5d-99102d2474d2 None None] Child 87794 exited with status 0 Jul 30 16:33:31 devstack cinder-volume[88080]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 30 16:33:31 devstack cinder-volume[88080]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:33:31 devstack cinder-volume[88080]: we strongly recommend against using it for new projects. Jul 30 16:33:31 devstack cinder-volume[88080]: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:33:31 devstack cinder-volume[88080]: framework. For more detail see Jul 30 16:33:31 devstack cinder-volume[88080]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:33:31 devstack cinder-volume[88080]: import eventlet # noqa Jul 30 16:33:33 devstack cinder-volume[88080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 30 16:33:33 devstack cinder-volume[88080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 30 16:33:33 devstack cinder-volume[88080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 30 16:33:34 devstack cinder-volume[88080]: INFO dbcounter [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Registered counter for database cinder Jul 30 16:33:34 devstack cinder-volume[88080]: DEBUG oslo_db.sqlalchemy.engines [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG dbcounter [-] [88080] Writer thread running {{(pid=88080) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:33:35 devstack cinder-volume[88080]: INFO cinder.rpc [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 30 16:33:35 devstack cinder-volume[88080]: INFO cinder.rpc [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_db.sqlalchemy.engines [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:35 devstack cinder-volume[88080]: INFO cinder.volume.manager [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Determined volume DB was empty at startup. Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG cinder.volume.manager [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88080) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 30 16:33:35 devstack cinder-volume[88080]: WARNING stevedore.named [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 30 16:33:35 devstack cinder-volume[88080]: WARNING castellan.key_manager [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:33:35 devstack cinder-volume[88080]: WARNING cinder.keymgr.conf_key_mgr [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 30 16:33:35 devstack cinder-volume[88080]: INFO cinder.volume.manager [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_db.sqlalchemy.engines [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:35 devstack cinder-volume[88080]: INFO oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Starting 1 workers Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Started child 88380 {{(pid=88080) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Full set of CONF: {{(pid=88080) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] ******************************************************************************** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] Configuration options gathered from: {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] ================================================================================ {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] allow_availability_zone_fallback = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] allow_compression_on_image_upload = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] allowed_direct_url_schemes = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88380]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] api_rate_limit = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] auth_strategy = keystone {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_availability_zone = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_host = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_stats_polling_interval = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backup_api_class = cinder.backup.api.API {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backup_name_template = backup-%s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backup_use_same_host = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backup_use_temp_snapshot = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] chap_password = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] chap_username = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_internal_tenant_project_id = ac3f81b7b0934309a941613ee6a07f68 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_internal_tenant_user_id = 781c158b2e594ee6b44933c7dbd5591f {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cluster = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] compression_format = gzip {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] compute_api_class = cinder.compute.nova.API {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] config_dir = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] config_source = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] control_exchange = openstack {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] debug = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] default_availability_zone = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] default_group_type = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] default_volume_type = QuobyteHD {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] disk_geometry = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] driver_client_cert = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] driver_client_cert_key = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] driver_data_namespace = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] driver_ssl_cert_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] driver_ssl_cert_verify = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] driver_use_ssl = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] enable_new_services = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] enable_unsupported_driver = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] enabled_backends = ['QuobyteHD'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] enforce_multipath_for_image_xfer = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] filter_function = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_api_insecure = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_api_servers = ['http://192.168.122.63/image'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_api_ssl_compression = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_ca_certificates_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_catalog_info = image:glance:publicURL {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_num_retries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance_request_timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] goodness_function = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] graceful_shutdown_timeout = 5 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] group_api_class = cinder.group.api.API {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] host = devstack {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_compress_on_upload = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_conversion_address_space_limit = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_conversion_cpu_limit = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_conversion_disable = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_upload_use_cinder_backend = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_upload_use_internal_tenant = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_volume_cache_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_volume_cache_max_count = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] image_volume_cache_max_size_gb = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] init_host_max_objects_retrieval = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] instance_format = [instance: %(uuid)s] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] iscsi_target_flags = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] iscsi_write_cache = on {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] iser_helper = tgtadm {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] iser_ip_address = 192.168.122.63 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] iser_port = 3260 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_color = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_config_append = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_dir = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_options = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_rotate_interval = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_rotate_interval_type = days {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] log_rotation_type = none {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] max_age = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] max_logfile_count = 30 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] max_logfile_size_mb = 200 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] max_over_subscription_ratio = 20.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] message_reap_interval = 86400 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] message_ttl = 2592000 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Starting volume driver QuobyteDriver (1.2) Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] migration_create_volume_timeout_secs = 300 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] monkey_patch = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88380) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] monkey_patch_modules = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] my_ip = 192.168.122.63 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] no_snapshot_gb_quota = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] num_iser_scan_tries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] num_shell_tries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] num_volume_device_scan_tries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] nvmeof_conn_info_version = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] nvmet_ns_id = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] nvmet_port_id = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_max_limit = 1000 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_volume_ext_list = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_volume_listen_port = 8776 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_volume_use_ssl = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] osapi_volume_workers = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] per_volume_size_limit = -1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] periodic_fuzzy_delay = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] periodic_interval = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] public_endpoint = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] publish_errors = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_backup_gigabytes = 1000 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_backups = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_gigabytes = 1000 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_groups = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_snapshots = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] quota_volumes = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] rate_limit_burst = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] rate_limit_except_level = CRITICAL {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] rate_limit_interval = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] reinit_driver_count = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] replication_device = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] report_discard_supported = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] report_interval = 120 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] reservation_clean_interval = 86400 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] reservation_expire = 86400 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] reserved_image_namespaces = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] reserved_percentage = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] rpc_response_timeout = 120 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] run_external_periodic_tasks = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] scst_target_driver = iscsi {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] scst_target_iqn_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_down_time = 720 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] shell_completion = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] snapshot_name_template = snapshot-%s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] split_loggers = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] state_path = /opt/stack/data/cinder {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] storage_availability_zone = nova {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] storage_protocol = iSCSI {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] syslog_log_facility = LOG_USER {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] target_helper = lioadm {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] target_ip_address = 192.168.122.63 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] target_port = 3260 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] target_protocol = iscsi {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] target_secondary_ip_addresses = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] trace_flags = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] transport_url = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] until_refresh = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_chap_auth = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_default_quota_class = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_journal = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_json = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_multipath_for_image_xfer = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_stderr = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] use_syslog = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] verify_glance_signatures = enabled {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_api_class = cinder.volume.api.API {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_backend_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_clear = zero {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_clear_ionice = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_clear_size = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_copy_bps_limit = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_dd_blocksize = 1M {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_name_template = volume-%s {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_service_inithost_offload = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volume_usage_audit_period = month {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] zoning_mode = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_concurrency.disable_process_locking = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.auth_section = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.auth_type = password {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.auth_version = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.cache = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.include_service_catalog = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.insecure = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.interface = public {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_password = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcache_username = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.region_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.service_type = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.63/identity {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.backend = dogpile.cache.null {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.backend_argument = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.backend_expiration_time = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.config_prefix = cache.oslo {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.debug_cache_backend = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.enable_retry_client = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.enable_socket_keepalive = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.expiration_time = 600 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.hashclient_retry_attempts = 2 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_dead_retry = 300 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_pool_maxsize = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_sasl_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.password = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.proxies = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.redis_db = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.redis_server = localhost:6379 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.retry_attempts = 2 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.retry_delay = 0.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.socket_keepalive_count = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.socket_keepalive_idle = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.socket_keepalive_interval = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.socket_timeout = 1.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.tls_allowed_ciphers = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.tls_cafile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.tls_certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.tls_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.tls_keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cache.username = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] coordination.backend_url = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.asyncio_connection = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.asyncio_slave_connection = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.backend = sqlalchemy {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.connection = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.connection_debug = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.connection_parameters = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.connection_recycle_time = 3600 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.connection_trace = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.db_inc_retry_interval = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.db_max_retries = 20 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88380) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 30 16:33:35 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.db_max_retry_interval = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.db_retry_interval = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.max_overflow = 50 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Running cmd (subprocess): mount.quobyte {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.max_pool_size = 5 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.max_retries = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.mysql_wsrep_sync_wait = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.pool_timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.retry_interval = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.slave_connection = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.sqlite_synchronous = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.synchronous_reader = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] database.use_db_reconnect = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.connection_string = messaging:// {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.es_doc_type = notification {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.es_scroll_size = 10000 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.es_scroll_time = 2m {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.filter_error_trace = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.hmac_keys = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.sentinel_service_name = mymaster {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.socket_timeout = 0.1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.trace_requests = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler.trace_sqlalchemy = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler_jaeger.process_tags = {} {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler_jaeger.service_name_prefix = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] profiler_otlp.service_name_prefix = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.enforce_new_defaults = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.policy_default_rule = default {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.policy_file = policy.yaml {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.group = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.helper_command = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] privsep_osbrick.user = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.group = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.helper_command = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] cinder_sys_admin.user = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.auth_section = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.auth_type = password {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.cafile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.collect_timing = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.insecure = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.send_service_user_token = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.split_loggers = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] service_user.timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.auth_section = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.auth_type = password {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.collect_timing = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.insecure = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.region_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.split_loggers = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] glance.timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.backend_availability_zone = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.chap_password = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.chap_username = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.disk_geometry = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.driver_client_cert = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.driver_client_cert_key = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.driver_data_namespace = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.driver_use_ssl = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.extra_capabilities = {} {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.filter_function = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.goodness_function = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.iscsi_target_flags = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.iscsi_write_cache = on {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.iser_helper = tgtadm {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.iser_ip_address = 192.168.122.63 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.iser_port = 3260 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_host = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_login = admin {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_mount_options = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_password = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_private_key = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_share_path = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.num_shell_tries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.quobyte_volume_url = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.replication_device = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.report_discard_supported = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.reserved_percentage = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.target_helper = tgtadm {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.target_ip_address = 192.168.122.63 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.target_port = 3260 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.target_protocol = iscsi {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.trace_flags = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.unique_fqdn_network = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack quobyte-client[88381]: Reading configuration file: /etc/quobyte/client.cfg Jul 30 16:33:35 devstack quobyte-client[88381]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.use_chap_auth = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_backend_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_clear = zero {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_clear_ionice = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_clear_size = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_reports.file_event_handler = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_reports.log_dir = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.backend_availability_zone = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.backend_host = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.chap_password = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.chap_username = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.chiscsi_conf = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.disk_geometry = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.driver_client_cert = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.driver_data_namespace = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.driver_use_ssl = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.extra_capabilities = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.filter_function = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.goodness_function = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.iser_helper = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.iser_ip_address = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.iser_port = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.iser_target_prefix = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_host = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_login = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_mount_options = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_password = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_private_key = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_share_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_ssh_port = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.num_shell_tries = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.nvmet_port_id = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.replication_device = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.report_discard_supported = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.reserved_percentage = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.scst_target_driver = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.storage_protocol = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.target_helper = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.target_ip_address = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.target_port = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.target_prefix = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.target_protocol = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.trace_flags = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.use_chap_auth = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_clear = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_clear_size = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] QuobyteHD.volumes_dir = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_notifications.driver = [] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_notifications.retry = -1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] key_manager.fixed_key = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.barbican_api_version = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.barbican_endpoint = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.barbican_endpoint_type = public {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.barbican_region_name = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.cafile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.collect_timing = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.insecure = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.number_of_retries = 60 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.retry_delay = 1 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.send_service_user_token = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.split_loggers = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.verify_ssl = True {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican.verify_ssl_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.auth_section = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.auth_type = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.cafile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.certfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.collect_timing = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.insecure = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.keyfile = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.split_loggers = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] barbican_service_user.timeout = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.approle_role_id = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.approle_secret_id = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.auth_method = approle {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.auth_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.kv_mountpoint = secret {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.kv_path = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.kv_version = 2 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.namespace = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.root_token_id = **** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.ssl_ca_crt_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.timeout = 60.0 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.token_file = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.token_role = None {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.use_ssl = False {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 30 16:33:35 devstack cinder-volume[88080]: DEBUG oslo_service.backend._eventlet.service [None req-398b1725-46db-42c3-845c-6cea85eb5e46 None None] ******************************************************************************** {{(pid=88080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 30 16:33:35 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:35 devstack cinder-volume[88380]: INFO cinder.volume.driver [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Driver hasn't implemented _init_vendor_properties() Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.driver [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.74658203125, 'free_capacity_gb': 1775.74658203125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88380) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_db.sqlalchemy.engines [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writer thread running {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.db.api [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Building query based on filter {{(pid=88380) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88380) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:35 devstack cinder-volume[88380]: INFO cinder.keymgr.migration [None req-67e93104-fd13-490e-9a4f-1ded2cfcd68a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 30 16:33:35 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:35 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:36 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.229s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:33:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Driver initialization completed successfully. Jul 30 16:33:36 devstack cinder-volume[88380]: INFO cinder.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Initiating service 3 cleanup Jul 30 16:33:36 devstack cinder-volume[88380]: INFO cinder.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Service 3 cleanup completed. Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG cinder.service [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Creating RPC server for service cinder-volume {{(pid=88380) start /opt/stack/cinder/cinder/service.py:231}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG cinder.service [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88380) start /opt/stack/cinder/cinder/service.py:237}} Jul 30 16:33:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:33:36 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:33:36 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:33:36 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Jul 30 16:33:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:33:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-efff1a5b-68c8-4375-ad11-a31d55e66415 None None] Driver post RPC initialization completed successfully. Jul 30 16:33:45 devstack cinder-volume[88080]: DEBUG dbcounter [-] [88080] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88080) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:33:46 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:33:46 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=2 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:33:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:33:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 6 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:33:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Flow 'volume_create_manager' (2c4043b3-a7fa-4bb7-a22c-b21e49023240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81f77cf-b874-44c6-accc-10c6d4bc2057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81f77cf-b874-44c6-accc-10c6d4bc2057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-110669269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0654e6e8-5e8d-496b-a2ad-47d07dd0b096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0d3e619a1a44d9907b43380beb9c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:34Z,use_quota=True,user_id='99f59d73158e4ac9a1d0abd6b259afec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bdee0f9-a554-407b-bcf1-82c208a5a95f),volume_type_id=9bdee0f9-a554-407b-bcf1-82c208a5a95f)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6fae8-540a-49d6-879c-6a0ce4c97ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e6fae8-540a-49d6-879c-6a0ce4c97ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580053e4-2400-4c45-9497-bf658385aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580053e4-2400-4c45-9497-bf658385aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0654e6e8-5e8d-496b-a2ad-47d07dd0b096', 'volume_name': 'volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a8493-5126-4d86-a951-0d6bc86aa58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a8493-5126-4d86-a951-0d6bc86aa58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a692f60c-56e5-458b-855d-fae2c285b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Volume 0654e6e8-5e8d-496b-a2ad-47d07dd0b096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096', 'volume_size': 1} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-110669269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0654e6e8-5e8d-496b-a2ad-47d07dd0b096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0d3e619a1a44d9907b43380beb9c90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:34Z,use_quota=True,user_id='99f59d73158e4ac9a1d0abd6b259afec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bdee0f9-a554-407b-bcf1-82c208a5a95f),volume_type_id=9bdee0f9-a554-407b-bcf1-82c208a5a95f)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Creating volume 0654e6e8-5e8d-496b-a2ad-47d07dd0b096 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:35 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:35 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 1073741824 Jul 30 16:34:35 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Flow 'volume_create_manager' (f7bd6624-7fe3-43a5-a7b4-463ff5072891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15794476-bc31-470e-9c80-a6e941bbecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15794476-bc31-470e-9c80-a6e941bbecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1272195501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62182c0d-a830-4680-abcc-29ce1d811871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a7f2162d454a6aabe1f70d70254a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:35Z,use_quota=True,user_id='022386e8cd864a4cb34bc56d4d972f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f24ce2-a5c1-4fce-802c-3391cd8ebbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f24ce2-a5c1-4fce-802c-3391cd8ebbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72f3b7e-814b-44fd-82cd-b923b5ada098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a72f3b7e-814b-44fd-82cd-b923b5ada098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62182c0d-a830-4680-abcc-29ce1d811871', 'volume_name': 'volume-62182c0d-a830-4680-abcc-29ce1d811871', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731852af-b7d1-4ebc-b66a-d71279674f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (731852af-b7d1-4ebc-b66a-d71279674f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33190036-a4ef-4224-bae2-03e5314e5bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Volume 62182c0d-a830-4680-abcc-29ce1d811871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62182c0d-a830-4680-abcc-29ce1d811871', 'volume_size': 1} Jul 30 16:34:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:36 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 1073741824" returned: 0 in 1.193s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:36 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 Jul 30 16:34:36 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:36 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096" returned: 0 in 0.436s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1272195501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62182c0d-a830-4680-abcc-29ce1d811871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a7f2162d454a6aabe1f70d70254a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:35Z,use_quota=True,user_id='022386e8cd864a4cb34bc56d4d972f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Creating volume 62182c0d-a830-4680-abcc-29ce1d811871 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:36 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:36 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 1073741824 Jul 30 16:34:36 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a692f60c-56e5-458b-855d-fae2c285b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634e6347-c272-4510-9535-1f2fb449e07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:36 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Volume volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 (0654e6e8-5e8d-496b-a2ad-47d07dd0b096): created successfully Jul 30 16:34:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634e6347-c272-4510-9535-1f2fb449e07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Flow 'volume_create_manager' (2c4043b3-a7fa-4bb7-a22c-b21e49023240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:37 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-76acbab3-601b-4ce6-ac98-87a2e9158f44 tempest-VolumeTypesAccessTest-30754153 None] Created volume successfully. Jul 30 16:34:38 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 1073741824" returned: 0 in 1.290s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:38 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 Jul 30 16:34:38 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Acquiring lock "cinder-0654e6e8-5e8d-496b-a2ad-47d07dd0b096-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Lock "cinder-0654e6e8-5e8d-496b-a2ad-47d07dd0b096-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Acquiring lock "cinder-quobyte-0654e6e8-5e8d-496b-a2ad-47d07dd0b096" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Lock "cinder-quobyte-0654e6e8-5e8d-496b-a2ad-47d07dd0b096" acquired by "delete_volume" :: waited 0.060s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:38 devstack cinder-volume[88380]: INFO oslo.privsep.daemon [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp947562gg/privsep.sock'] Jul 30 16:34:38 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp947562gg/privsep.sock Jul 30 16:34:38 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:38 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33190036-a4ef-4224-bae2-03e5314e5bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62182c0d-a830-4680-abcc-29ce1d811871', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ce8330-aa45-4b4f-9022-d23f14b45878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Volume volume-62182c0d-a830-4680-abcc-29ce1d811871 (62182c0d-a830-4680-abcc-29ce1d811871): created successfully Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ce8330-aa45-4b4f-9022-d23f14b45878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Flow 'volume_create_manager' (f7bd6624-7fe3-43a5-a7b4-463ff5072891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e20f2bb0-79e8-4791-90d7-c8131e99b978 tempest-TaggedAttachmentsTest-641084452 None] Created volume successfully. Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: Jul 30 16:34:40 devstack cinder-volume[88380]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 30 16:34:40 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:40 devstack cinder-volume[88380]: INFO oslo.privsep.daemon [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Spawned new privsep daemon via rootwrap Jul 30 16:34:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Accepted privsep connection to /tmp/tmp947562gg/privsep.sock {{(pid=88380) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 30 16:34:40 devstack cinder-volume[88380]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 30 16:34:40 devstack cinder-volume[88380]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 30 16:34:40 devstack cinder-volume[88380]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 30 16:34:40 devstack cinder-volume[88380]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89440 Jul 30 16:34:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e5dd3d-df81-4217-9b3b-2aa97e0d98b9]: (2,) {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[da85f8ed-8f9f-4e61-8d96-ebc1730883a1]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:40 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 Jul 30 16:34:40 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:41 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:41 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096 Jul 30 16:34:41 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:41 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654e6e8-5e8d-496b-a2ad-47d07dd0b096" returned: 0 in 0.293s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Lock "cinder-quobyte-0654e6e8-5e8d-496b-a2ad-47d07dd0b096" released by "delete_volume" :: held 2.833s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:41 devstack cinder-volume[88380]: WARNING cinder.quota [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1476735423 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1476735423, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:34:41 devstack cinder-volume[88380]: WARNING cinder.quota [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1476735423 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1476735423, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Created reservations ['2123e0f7-79a1-496c-a143-565d6ccf426f', '0dcade60-9ae0-47e6-ac36-5f663e407f64', 'cbc0339f-d61a-4f70-ad40-0aa56b0a284b', '17e0023d-91d2-48d9-9efe-b31df05c832a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:41 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:34:41 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:42 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.422s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:42 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Deleted volume successfully. Jul 30 16:34:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fd86f324-9dcc-480e-966a-83355c1fd6b5 tempest-VolumeTypesAccessTest-30754153 None] Lock "cinder-0654e6e8-5e8d-496b-a2ad-47d07dd0b096-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Flow 'volume_create_manager' (812c1b01-71b7-45dc-9921-4de39b5e8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e25f25-139b-4b03-be2b-4a9ddf64deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e25f25-139b-4b03-be2b-4a9ddf64deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2002167027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba8ecea-a92b-41d1-93d6-796feea4a27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00a11aaecaa4ff6aeb1005c5da30d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:44Z,use_quota=True,user_id='14ef26b1bfb34e088ab500aa091002da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605781a6-de40-4ba9-84cf-ac5caf21c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605781a6-de40-4ba9-84cf-ac5caf21c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e78cb8-1ce1-4e1f-8f1b-d9d8548714b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e78cb8-1ce1-4e1f-8f1b-d9d8548714b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba8ecea-a92b-41d1-93d6-796feea4a27b', 'volume_name': 'volume-fba8ecea-a92b-41d1-93d6-796feea4a27b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e126f1-5b15-40c2-b2f6-074b90d05892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e126f1-5b15-40c2-b2f6-074b90d05892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f8e392-cb26-48b5-810f-fe6424b49280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Volume fba8ecea-a92b-41d1-93d6-796feea4a27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba8ecea-a92b-41d1-93d6-796feea4a27b', 'volume_size': 1} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2002167027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba8ecea-a92b-41d1-93d6-796feea4a27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00a11aaecaa4ff6aeb1005c5da30d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:44Z,use_quota=True,user_id='14ef26b1bfb34e088ab500aa091002da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Creating volume fba8ecea-a92b-41d1-93d6-796feea4a27b {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:44 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:34:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:44 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b 1073741824 Jul 30 16:34:44 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:45 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b 1073741824" returned: 0 in 0.654s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:45 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b Jul 30 16:34:45 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:45 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f8e392-cb26-48b5-810f-fe6424b49280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba8ecea-a92b-41d1-93d6-796feea4a27b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c029bc92-9890-4fcb-bf35-7a2be0628370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Volume volume-fba8ecea-a92b-41d1-93d6-796feea4a27b (fba8ecea-a92b-41d1-93d6-796feea4a27b): created successfully Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c029bc92-9890-4fcb-bf35-7a2be0628370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Flow 'volume_create_manager' (812c1b01-71b7-45dc-9921-4de39b5e8212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c9378938-2790-4d0c-b9f3-e5a7be79f724 tempest-ServersNegativeTestJSON-1520797424 None] Created volume successfully. Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Flow 'volume_create_manager' (60f4abbe-45e0-4ab3-9d82-bb5849faab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683a565c-249a-4cf9-aa5d-aea905a00be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683a565c-249a-4cf9-aa5d-aea905a00be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2026540534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dcff09-0b05-47ff-b11d-6a5f464dbe3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00a11aaecaa4ff6aeb1005c5da30d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:52Z,use_quota=True,user_id='14ef26b1bfb34e088ab500aa091002da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f6e2c1-c2bf-4543-8e55-ae1578e4269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f6e2c1-c2bf-4543-8e55-ae1578e4269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c733c5f-6543-4c9b-ac0d-7b360e1019d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c733c5f-6543-4c9b-ac0d-7b360e1019d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19dcff09-0b05-47ff-b11d-6a5f464dbe3d', 'volume_name': 'volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a370058-487e-48ac-b936-718bbf0adb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a370058-487e-48ac-b936-718bbf0adb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f811694-845d-478a-8462-ad2a293812fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:52 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Volume 19dcff09-0b05-47ff-b11d-6a5f464dbe3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d', 'volume_size': 1} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2026540534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dcff09-0b05-47ff-b11d-6a5f464dbe3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00a11aaecaa4ff6aeb1005c5da30d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:34:52Z,use_quota=True,user_id='14ef26b1bfb34e088ab500aa091002da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Creating volume 19dcff09-0b05-47ff-b11d-6a5f464dbe3d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:34:52 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:52 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d 1073741824 Jul 30 16:34:52 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:52 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d 1073741824" returned: 0 in 0.868s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:52 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d Jul 30 16:34:52 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:53 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d" returned: 0 in 0.374s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f811694-845d-478a-8462-ad2a293812fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be367a11-8ab5-4a49-b19f-30e082617441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:34:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Volume volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d (19dcff09-0b05-47ff-b11d-6a5f464dbe3d): created successfully Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be367a11-8ab5-4a49-b19f-30e082617441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:34:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Flow 'volume_create_manager' (60f4abbe-45e0-4ab3-9d82-bb5849faab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:34:53 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-137870cc-e83f-4da3-b1c5-b0d315095894 tempest-ServersNegativeTestJSON-1520797424 None] Created volume successfully. Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:54 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:34:54 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "cinder-19dcff09-0b05-47ff-b11d-6a5f464dbe3d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-19dcff09-0b05-47ff-b11d-6a5f464dbe3d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "cinder-quobyte-19dcff09-0b05-47ff-b11d-6a5f464dbe3d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-quobyte-19dcff09-0b05-47ff-b11d-6a5f464dbe3d" acquired by "delete_volume" :: waited 0.044s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[555efaf3-9804-41c9-b61a-3c94bf887ff7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:55 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d Jul 30 16:34:55 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:55 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.731s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 8 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:34:55 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d" returned: 0 in 0.743s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:55 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d Jul 30 16:34:55 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:56 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19dcff09-0b05-47ff-b11d-6a5f464dbe3d" returned: 0 in 0.395s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-quobyte-19dcff09-0b05-47ff-b11d-6a5f464dbe3d" released by "delete_volume" :: held 1.259s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:56 devstack cinder-volume[88380]: WARNING cinder.quota [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:34:56 devstack cinder-volume[88380]: WARNING cinder.quota [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Created reservations ['f180b85f-2fb1-4ad5-b598-22e463ad5d1d', 'c8e01bb5-7ca3-400c-869f-ff1457ae0a1f', 'f227964f-46cd-4cbc-81fc-a56cc1df5a4d', '8dc98f09-128a-4774-8eec-345e8e2a3727'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:56 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:34:56 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:56 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Deleted volume successfully. Jul 30 16:34:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11ffaaa3-adf8-4da7-95eb-53a0845f3758 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-19dcff09-0b05-47ff-b11d-6a5f464dbe3d-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "cinder-fba8ecea-a92b-41d1-93d6-796feea4a27b-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-fba8ecea-a92b-41d1-93d6-796feea4a27b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "cinder-quobyte-fba8ecea-a92b-41d1-93d6-796feea4a27b" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:34:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-quobyte-fba8ecea-a92b-41d1-93d6-796feea4a27b" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:34:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21ba94-1ef6-47a8-92bd-ec1743f1b123]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:34:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:57 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b Jul 30 16:34:57 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:58 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b" returned: 0 in 0.499s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:58 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b Jul 30 16:34:58 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:58 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fba8ecea-a92b-41d1-93d6-796feea4a27b" returned: 0 in 0.404s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-quobyte-fba8ecea-a92b-41d1-93d6-796feea4a27b" released by "delete_volume" :: held 0.998s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Created reservations ['3401c7bd-4352-4ad4-98dd-e210ec4bbef1', 'fe495863-93c5-44ec-a8e3-f082a53955f2', '948bba98-fdf5-405d-9db4-063eced68dbb', 'd5bf0647-a946-4496-b4e8-a4b4ac265a54'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:34:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:34:58 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:34:58 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:34:59 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Jul 30 16:34:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:34:59 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:34:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Deleted volume successfully. Jul 30 16:34:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-808d3a9b-c857-44ed-8d7c-512f6a8792e0 tempest-ServersNegativeTestJSON-1520797424 None] Lock "cinder-fba8ecea-a92b-41d1-93d6-796feea4a27b-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:08 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=38,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:35:09 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=8 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Flow 'volume_create_manager' (0396dfed-3f6f-4302-babe-19ea9e453a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac5eeee-a984-4163-aca8-b4ac41f70b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aac5eeee-a984-4163-aca8-b4ac41f70b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-895217463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c440a2-1342-4de0-aab8-b360e7af84c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733a46cae4734c2da30e7063bf382622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:14Z,use_quota=True,user_id='034fb17f9dcc4d68a7cb376066ba1a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866d798a-38d9-40f6-8ed0-7197ada0def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866d798a-38d9-40f6-8ed0-7197ada0def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa060c7-b304-45d8-9a0a-28e22773ddbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa060c7-b304-45d8-9a0a-28e22773ddbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c440a2-1342-4de0-aab8-b360e7af84c7', 'volume_name': 'volume-f4c440a2-1342-4de0-aab8-b360e7af84c7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0a0175-8508-495a-8408-4302b2cf929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0a0175-8508-495a-8408-4302b2cf929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2c0ff7-4c37-4ecd-9179-75668a786741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Volume f4c440a2-1342-4de0-aab8-b360e7af84c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c440a2-1342-4de0-aab8-b360e7af84c7', 'volume_size': 1} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-895217463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c440a2-1342-4de0-aab8-b360e7af84c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733a46cae4734c2da30e7063bf382622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:14Z,use_quota=True,user_id='034fb17f9dcc4d68a7cb376066ba1a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Creating volume f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:14 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:14 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 1073741824 Jul 30 16:35:14 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:14 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 1073741824" returned: 0 in 0.511s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:14 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 Jul 30 16:35:14 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:15 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7" returned: 0 in 0.354s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2c0ff7-4c37-4ecd-9179-75668a786741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c440a2-1342-4de0-aab8-b360e7af84c7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94139a06-a50d-48cf-ad0d-af04791cbf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:15 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Volume volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 (f4c440a2-1342-4de0-aab8-b360e7af84c7): created successfully Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94139a06-a50d-48cf-ad0d-af04791cbf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Flow 'volume_create_manager' (0396dfed-3f6f-4302-babe-19ea9e453a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-469267f3-4711-480a-8a7a-8ddc2dfbe95a req-54958122-afdf-4995-8e63-acf3d2535ee1 tempest-VolumesSnapshotsTestJSON-1592711383 None] Created volume successfully. Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Creating offline snapshot e53aceac-fe28-4e72-bf23-936202cb0e73 of volume f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371d968-d6c8-4d36-a555-3438bf590194]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:16 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 Jul 30 16:35:16 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:16 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7" returned: 0 in 0.652s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:16 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 1G Jul 30 16:35:16 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:17 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 1G" returned: 0 in 0.625s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:17 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 Jul 30 16:35:17 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:17 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73" returned: 0 in 0.422s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:17 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 is being set with open permissions: ugo+rw Jul 30 16:35:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:17 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 Jul 30 16:35:17 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:17 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:17 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info Jul 30 16:35:17 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:18 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info" returned: 0 in 0.347s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:18 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info is being set with open permissions: ugo+rw Jul 30 16:35:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:18 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info Jul 30 16:35:18 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:18 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.info" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-e590f672-5c40-4b41-b0f9-d91668df5218 req-66e14c78-36f0-4397-b904-a3a0f52a22b9 tempest-VolumesSnapshotsTestJSON-1592711383 None] Create snapshot completed successfully Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "cinder-e53aceac-fe28-4e72-bf23-936202cb0e73-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-e53aceac-fe28-4e72-bf23-936202cb0e73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "cinder-quobyte-f4c440a2-1342-4de0-aab8-b360e7af84c7" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-quobyte-f4c440a2-1342-4de0-aab8-b360e7af84c7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "cinder-quobyte-e53aceac-fe28-4e72-bf23-936202cb0e73" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-quobyte-e53aceac-fe28-4e72-bf23-936202cb0e73" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Deleting offline snapshot e53aceac-fe28-4e72-bf23-936202cb0e73 of volume f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] snapshot_file for this snap is: volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ed25e6-62ab-4a17-9fa3-c8c2be9bcf88]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:20 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 Jul 30 16:35:20 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:20 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73" returned: 0 in 0.444s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4c440a2-1342-4de0-aab8-b360e7af84c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:35:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfb53da-5344-4513-ac2d-a645bfa98f32]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:20 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 Jul 30 16:35:20 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:20 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7" returned: 0 in 0.496s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:20 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 Jul 30 16:35:20 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:21 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73" returned: 0 in 0.434s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:21 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73 Jul 30 16:35:21 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:21 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7.e53aceac-fe28-4e72-bf23-936202cb0e73" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-quobyte-e53aceac-fe28-4e72-bf23-936202cb0e73" released by "_delete_snapshot" :: held 1.837s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-quobyte-f4c440a2-1342-4de0-aab8-b360e7af84c7" released by "delete_snapshot" :: held 1.863s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:21 devstack cinder-volume[88380]: WARNING cinder.quota [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG cinder.quota [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Created reservations ['78acb315-cff9-4c22-bb66-999234c3127d', '361d738e-d9cf-41d2-a90f-0ee5eb9e24cc', 'de1fb8da-9aa7-4ef3-97d6-1192671a8145', '306b0b89-416e-4778-8320-afda1895b889'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Delete snapshot completed successfully. Jul 30 16:35:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-dae73d32-f4b0-4796-83cc-1c836a4bd1f4 req-03fa2863-b19d-4fe3-9a48-1006ccea9997 tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-e53aceac-fe28-4e72-bf23-936202cb0e73-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "cinder-f4c440a2-1342-4de0-aab8-b360e7af84c7-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-f4c440a2-1342-4de0-aab8-b360e7af84c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "cinder-quobyte-f4c440a2-1342-4de0-aab8-b360e7af84c7" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-quobyte-f4c440a2-1342-4de0-aab8-b360e7af84c7" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd37780-372c-479e-bf58-d9a7bdaca0ff]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:22 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 Jul 30 16:35:22 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:22 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7" returned: 0 in 0.417s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:22 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7 Jul 30 16:35:22 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:22 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f4c440a2-1342-4de0-aab8-b360e7af84c7" returned: 0 in 0.298s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-quobyte-f4c440a2-1342-4de0-aab8-b360e7af84c7" released by "delete_volume" :: held 0.800s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG cinder.quota [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Created reservations ['f4d0f5a4-c609-4911-9327-99e13d1a9f83', '770cbdd5-13e5-4cf6-b4d8-4420285dedef', 'e27dd4ef-e923-493b-b29a-22779ee6b44e', '0b04753f-01c9-431e-900b-547c7234022c'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:23 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:35:23 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:23 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG cinder.manager [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Deleted volume successfully. Jul 30 16:35:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-88b5f098-dc63-4c39-95ee-a4591f6506db req-ca08d988-29e3-46fd-aa49-b01dcd17d65c tempest-VolumesSnapshotsTestJSON-1592711383 None] Lock "cinder-f4c440a2-1342-4de0-aab8-b360e7af84c7-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Flow 'volume_create_manager' (076322ed-2a12-41b1-bb9d-94640ddba895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f7c8fc-f5f1-4f47-b3e4-fd1d7ebdfe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f7c8fc-f5f1-4f47-b3e4-fd1d7ebdfe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1684928873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f459c8883e94a02ad65356470977609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:32Z,use_quota=True,user_id='fe7f5df4e6a14c0e9bc6a6659adbc899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea14037-fef7-4045-aa16-0b5ffd5b7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea14037-fef7-4045-aa16-0b5ffd5b7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239cda54-87d0-46d9-92d9-3b615fde518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239cda54-87d0-46d9-92d9-3b615fde518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8', 'volume_name': 'volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648fa4d9-22c5-4c4c-b138-fe7eb48c17e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648fa4d9-22c5-4c4c-b138-fe7eb48c17e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb648d31-6110-42fd-9dc3-c814e6bf9b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Volume 7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8', 'volume_size': 1} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1684928873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f459c8883e94a02ad65356470977609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:32Z,use_quota=True,user_id='fe7f5df4e6a14c0e9bc6a6659adbc899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Creating volume 7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:31 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:35:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:32 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 1073741824 Jul 30 16:35:32 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:32 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 1073741824" returned: 0 in 0.664s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:32 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 Jul 30 16:35:32 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:33 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8" returned: 0 in 0.362s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb648d31-6110-42fd-9dc3-c814e6bf9b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab48e2d-7336-430c-aaf9-408b29bb3feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Volume volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 (7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8): created successfully Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab48e2d-7336-430c-aaf9-408b29bb3feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Flow 'volume_create_manager' (076322ed-2a12-41b1-bb9d-94640ddba895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2ed7f7ea-6878-48a8-8bdc-27c89cfa1e82 tempest-VolumesTestJSON-614500660 None] Created volume successfully. Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Flow 'volume_create_manager' (525f131c-7613-4ff7-8552-67c3caa1b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b069b22e-54ae-4887-a897-e95920d57f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b069b22e-54ae-4887-a897-e95920d57f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1972915199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23511336-0d24-4e23-ac34-80da772aaa91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f459c8883e94a02ad65356470977609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:35Z,use_quota=True,user_id='fe7f5df4e6a14c0e9bc6a6659adbc899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6dcb69-21c2-4c74-b0a1-cce757ba72d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6dcb69-21c2-4c74-b0a1-cce757ba72d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86476222-45a3-4579-ba8a-620dd8389e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86476222-45a3-4579-ba8a-620dd8389e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23511336-0d24-4e23-ac34-80da772aaa91', 'volume_name': 'volume-23511336-0d24-4e23-ac34-80da772aaa91', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a150ae9e-c54d-4346-828f-0bb3b8001c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a150ae9e-c54d-4346-828f-0bb3b8001c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cf0c74-e84c-4a4c-b8b2-1f13daa712e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Volume 23511336-0d24-4e23-ac34-80da772aaa91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23511336-0d24-4e23-ac34-80da772aaa91', 'volume_size': 1} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1972915199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23511336-0d24-4e23-ac34-80da772aaa91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f459c8883e94a02ad65356470977609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:35Z,use_quota=True,user_id='fe7f5df4e6a14c0e9bc6a6659adbc899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Creating volume 23511336-0d24-4e23-ac34-80da772aaa91 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:34 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:35:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:34 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 1073741824 Jul 30 16:35:34 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:35 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 1073741824" returned: 0 in 0.610s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:35 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 Jul 30 16:35:35 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:35 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cf0c74-e84c-4a4c-b8b2-1f13daa712e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23511336-0d24-4e23-ac34-80da772aaa91', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc7ceb1-5da0-481c-8d12-b3ee24a7efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Volume volume-23511336-0d24-4e23-ac34-80da772aaa91 (23511336-0d24-4e23-ac34-80da772aaa91): created successfully Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc7ceb1-5da0-481c-8d12-b3ee24a7efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Flow 'volume_create_manager' (525f131c-7613-4ff7-8552-67c3caa1b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1828a867-06ab-4bef-80b6-3c2fe20690de tempest-VolumesTestJSON-614500660 None] Created volume successfully. Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Flow 'volume_create_manager' (1deff829-aa5c-456f-9913-2e2039e9ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b7e7fb-4821-4bdc-9f83-72ce1584c779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b7e7fb-4821-4bdc-9f83-72ce1584c779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1391009558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f459c8883e94a02ad65356470977609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:38Z,use_quota=True,user_id='fe7f5df4e6a14c0e9bc6a6659adbc899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd719f7a-b12e-42c0-94ce-deaf0b589507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd719f7a-b12e-42c0-94ce-deaf0b589507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e85111-0f5f-4765-afbd-51e5d82ecee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e85111-0f5f-4765-afbd-51e5d82ecee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf', 'volume_name': 'volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6266a6f1-5d6f-4321-9493-6cd8d1d05d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6266a6f1-5d6f-4321-9493-6cd8d1d05d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa6edaa-a380-4378-9ac0-2efa0f860add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Volume a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf', 'volume_size': 1} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1391009558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f459c8883e94a02ad65356470977609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:35:38Z,use_quota=True,user_id='fe7f5df4e6a14c0e9bc6a6659adbc899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Creating volume a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:35:38 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:38 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf 1073741824 Jul 30 16:35:38 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:38 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf 1073741824" returned: 0 in 0.640s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:38 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf Jul 30 16:35:38 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:39 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf" returned: 0 in 0.421s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa6edaa-a380-4378-9ac0-2efa0f860add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c01e23d-a397-4686-a62d-c8ec541640c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:35:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Volume volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf (a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf): created successfully Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c01e23d-a397-4686-a62d-c8ec541640c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:35:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Flow 'volume_create_manager' (1deff829-aa5c-456f-9913-2e2039e9ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:35:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9105a5d0-288b-4428-a4ea-19b6446eec7c tempest-VolumesTestJSON-614500660 None] Created volume successfully. Jul 30 16:35:41 devstack cinder-volume[88380]: WARNING py.warnings [req-b5d9cfad-95a1-4bdc-a79f-15d5c391cd07 req-41ce3d02-f0a9-433d-88a9-2321acff4658 tempest-TaggedAttachmentsTest-641084452 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 30 16:35:41 devstack cinder-volume[88380]: .first() Jul 30 16:35:41 devstack cinder-volume[88380]: Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-b5d9cfad-95a1-4bdc-a79f-15d5c391cd07 req-41ce3d02-f0a9-433d-88a9-2321acff4658 tempest-TaggedAttachmentsTest-641084452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-b5d9cfad-95a1-4bdc-a79f-15d5c391cd07 req-41ce3d02-f0a9-433d-88a9-2321acff4658 tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-b5d9cfad-95a1-4bdc-a79f-15d5c391cd07 req-41ce3d02-f0a9-433d-88a9-2321acff4658 tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-b5d9cfad-95a1-4bdc-a79f-15d5c391cd07 req-41ce3d02-f0a9-433d-88a9-2321acff4658 tempest-TaggedAttachmentsTest-641084452 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-62182c0d-a830-4680-abcc-29ce1d811871', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7380d95b-b8a3-4708-b1a7-6017dc30a859', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:35:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-b5d9cfad-95a1-4bdc-a79f-15d5c391cd07 req-41ce3d02-f0a9-433d-88a9-2321acff4658 tempest-TaggedAttachmentsTest-641084452 None] attachment_update completed successfully. Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Acquiring lock "cinder-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Lock "cinder-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Acquiring lock "cinder-quobyte-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Lock "cinder-quobyte-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[014c233f-a2f9-434c-a965-dbb6a023546a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:41 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf Jul 30 16:35:41 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:42 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf" returned: 0 in 0.480s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:42 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf Jul 30 16:35:42 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:42 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf" returned: 0 in 0.301s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Lock "cinder-quobyte-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf" released by "delete_volume" :: held 0.848s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Created reservations ['21ad970a-d0c9-48f1-b76c-89190c936963', '8ed0ffca-0cf7-4287-98a1-89a5ed6f734c', 'e4eca2f6-73c1-432a-b99f-bb1f1bdc7e09', 'fe843a4c-7499-49ae-be59-972dcbc70c06'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:42 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:35:42 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Acquiring lock "cinder-23511336-0d24-4e23-ac34-80da772aaa91-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Lock "cinder-23511336-0d24-4e23-ac34-80da772aaa91-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Acquiring lock "cinder-quobyte-23511336-0d24-4e23-ac34-80da772aaa91" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Lock "cinder-quobyte-23511336-0d24-4e23-ac34-80da772aaa91" acquired by "delete_volume" :: waited 0.061s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a7f4a-7e3b-41a6-9727-670944690d1d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:43 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Deleted volume successfully. Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9d63196-0994-4bd9-b592-f722f3c1adc4 tempest-VolumesTestJSON-614500660 None] Lock "cinder-a1b7fdf2-60e3-40bb-a367-f9c6e0c02dcf-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:43 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 Jul 30 16:35:43 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:43 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91" returned: 0 in 0.579s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:43 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91 Jul 30 16:35:43 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:43 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23511336-0d24-4e23-ac34-80da772aaa91" returned: 0 in 0.361s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Lock "cinder-quobyte-23511336-0d24-4e23-ac34-80da772aaa91" released by "delete_volume" :: held 1.038s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Created reservations ['c0102cd8-bf14-4190-ae15-aec2661f64c0', '4222df3c-bb27-4d3f-9f8b-7397c07757a2', 'ee912112-8f07-4c41-b434-8ac9aabf2e33', '259edb41-90aa-4cf9-9f34-989fa6991e5f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:44 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:35:44 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:44 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Deleted volume successfully. Jul 30 16:35:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2551f54f-f1bc-4f83-8568-64f3ccfa5ad5 tempest-VolumesTestJSON-614500660 None] Lock "cinder-23511336-0d24-4e23-ac34-80da772aaa91-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Acquiring lock "cinder-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Lock "cinder-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Acquiring lock "cinder-quobyte-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Lock "cinder-quobyte-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c4e9b8-0088-4a2f-9132-bad2b6af9d8a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:45 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 Jul 30 16:35:45 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:45 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8" returned: 0 in 0.431s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:45 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8 Jul 30 16:35:45 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:46 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Lock "cinder-quobyte-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8" released by "delete_volume" :: held 0.820s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Created reservations ['4fa1bc34-58bd-47e7-9080-061051db720c', '5fd8797b-a51d-4d45-8b21-094b557ab060', 'a17bbd90-36eb-43bb-b5ea-00ef59df8e0d', 'c10fa936-4112-46c4-b3a9-222c702f16fe'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:46 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:35:46 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:46 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.390s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Deleted volume successfully. Jul 30 16:35:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e429361a-45f5-4e9d-b83f-1b07b21f15e6 tempest-VolumesTestJSON-614500660 None] Lock "cinder-7afd0d5b-7606-4bc5-a5e6-2cb82eaf31f8-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:35:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-7562504f-b5f3-4633-bf22-ac41ba0c8362 req-af43fbf5-5c5f-409e-887a-59fca73014f1 tempest-TaggedAttachmentsTest-641084452 None] Terminate volume connection completed successfully. Jul 30 16:35:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-7562504f-b5f3-4633-bf22-ac41ba0c8362 req-af43fbf5-5c5f-409e-887a-59fca73014f1 tempest-TaggedAttachmentsTest-641084452 None] Deleting attachment 7380d95b-b8a3-4708-b1a7-6017dc30a859. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:35:54 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:35:54 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:35:54 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.338s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:35:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:35:59 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=44,cinder:UPDATE=57,cinder:INSERT=8,cinder:DELETE=5 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:35:59 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=49,cinder:SELECT=46,cinder:DELETE=4,cinder:INSERT=17 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:36:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7eb75ca0-709a-4e15-b6b3-65927465516a tempest-GroupsV314Test-1613749262 None] Group tempest-GroupsV314Test-Group-383361375: creating Jul 30 16:36:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7eb75ca0-709a-4e15-b6b3-65927465516a tempest-GroupsV314Test-1613749262 None] Group tempest-GroupsV314Test-Group-383361375: created successfully Jul 30 16:36:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7eb75ca0-709a-4e15-b6b3-65927465516a tempest-GroupsV314Test-1613749262 None] Create group completed successfully. Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Flow 'volume_create_manager' (e984677d-f81d-4f05-b91e-bb63d3c8f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559286b-50db-487d-9225-e2ac041897c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559286b-50db-487d-9225-e2ac041897c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365228594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b12340ef-7cd6-4bd6-b72a-a235fc39e959,host='devstack@QuobyteHD#QuobyteHD',id=df36c1f5-36b5-41d3-ae1f-e535c22055e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87d9e0c35524f0bba44a8b63c03caec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:04Z,use_quota=True,user_id='a56ae92ad6fe4649a78d0f72d2ef351f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de9fdd58-c208-449c-924a-3d8892ef5eb7),volume_type_id=de9fdd58-c208-449c-924a-3d8892ef5eb7)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d185b910-8246-497a-894f-09a9f3e0dce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d185b910-8246-497a-894f-09a9f3e0dce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c49574-8869-4873-8464-070ad0f21277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c49574-8869-4873-8464-070ad0f21277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df36c1f5-36b5-41d3-ae1f-e535c22055e1', 'volume_name': 'volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee09252-58e6-4498-9ba5-3816ff3cb66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee09252-58e6-4498-9ba5-3816ff3cb66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a50df6-6644-400e-9a5a-46a34e01ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Volume df36c1f5-36b5-41d3-ae1f-e535c22055e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1', 'volume_size': 1} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b12340ef-7cd6-4bd6-b72a-a235fc39e959,created_at=2026-07-30T14:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365228594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b12340ef-7cd6-4bd6-b72a-a235fc39e959,host='devstack@QuobyteHD#QuobyteHD',id=df36c1f5-36b5-41d3-ae1f-e535c22055e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d87d9e0c35524f0bba44a8b63c03caec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:04Z,use_quota=True,user_id='a56ae92ad6fe4649a78d0f72d2ef351f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de9fdd58-c208-449c-924a-3d8892ef5eb7),volume_type_id=de9fdd58-c208-449c-924a-3d8892ef5eb7)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Creating volume df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:04 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:04 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 1073741824 Jul 30 16:36:04 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:05 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 1073741824" returned: 0 in 1.245s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:05 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 Jul 30 16:36:05 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:06 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1" returned: 0 in 0.598s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a50df6-6644-400e-9a5a-46a34e01ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f03cc-772a-4afd-a44d-2ab973ccd3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Volume volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 (df36c1f5-36b5-41d3-ae1f-e535c22055e1): created successfully Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (829f03cc-772a-4afd-a44d-2ab973ccd3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Flow 'volume_create_manager' (e984677d-f81d-4f05-b91e-bb63d3c8f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e6dc86bd-7b7b-4e7f-aae3-81cf6765176f tempest-GroupsV314Test-1613749262 None] Created volume successfully. Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (7f762aa5-2235-4053-9c87-48501783fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cecbe8-4529-43c0-89e2-89f648f92a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cecbe8-4529-43c0-89e2-89f648f92a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430034199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8431ee1f-ec4e-47c8-9d31-117110e03df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:06Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa2995a-0222-4d4e-9c53-1320e8b6f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfa2995a-0222-4d4e-9c53-1320e8b6f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3e31ec-8b0c-4482-8ddd-cdeea6e92a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3e31ec-8b0c-4482-8ddd-cdeea6e92a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8431ee1f-ec4e-47c8-9d31-117110e03df2', 'volume_name': 'volume-8431ee1f-ec4e-47c8-9d31-117110e03df2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b0a50b-19d0-489c-874a-a68a45ec2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b0a50b-19d0-489c-874a-a68a45ec2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee53c522-f278-443b-bcb0-0038f16ac8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Volume 8431ee1f-ec4e-47c8-9d31-117110e03df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8431ee1f-ec4e-47c8-9d31-117110e03df2', 'volume_size': 1} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430034199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8431ee1f-ec4e-47c8-9d31-117110e03df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:06Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Creating volume 8431ee1f-ec4e-47c8-9d31-117110e03df2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:06 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:06 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 1073741824 Jul 30 16:36:06 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:07 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 1073741824" returned: 0 in 0.806s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:07 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 Jul 30 16:36:07 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:07 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2" returned: 0 in 0.347s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee53c522-f278-443b-bcb0-0038f16ac8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8431ee1f-ec4e-47c8-9d31-117110e03df2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e156d9b-5300-4d5b-a0e4-79680468acb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Volume volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 (8431ee1f-ec4e-47c8-9d31-117110e03df2): created successfully Jul 30 16:36:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e156d9b-5300-4d5b-a0e4-79680468acb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (7f762aa5-2235-4053-9c87-48501783fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4459634c-e180-4446-844d-6c73c8be2a65 tempest-VolumesActionsTest-1451078162 None] Created volume successfully. Jul 30 16:36:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-096affd3-8981-4683-a2eb-19ba7add4a77 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2" by "attach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-096affd3-8981-4683-a2eb-19ba7add4a77 tempest-VolumesActionsTest-1451078162 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2" acquired by "attach_volume" :: waited 0.162s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:09 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Cloning volume df36c1f5-36b5-41d3-ae1f-e535c22055e1 to volume 5f499612-3628-41a7-9c04-997a1563f837 Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Creating offline snapshot 778dded7-24e6-4268-bd6d-8ff025ed80a0 of volume df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:36:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-096affd3-8981-4683-a2eb-19ba7add4a77 tempest-VolumesActionsTest-1451078162 None] Attaching volume 8431ee1f-ec4e-47c8-9d31-117110e03df2 to instance 1e059e8f-ae88-447c-b570-fb04a57f2616 at mountpoint /dev/vdb on host None. Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd77feed-a6f2-43cd-b85d-0ce648137992]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Acquiring lock "cinder-62182c0d-a830-4680-abcc-29ce1d811871-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Lock "cinder-62182c0d-a830-4680-abcc-29ce1d811871-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-096affd3-8981-4683-a2eb-19ba7add4a77 tempest-VolumesActionsTest-1451078162 None] Attach volume completed successfully. Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-096affd3-8981-4683-a2eb-19ba7add4a77 tempest-VolumesActionsTest-1451078162 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2" released by "attach_volume" :: held 0.554s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Acquiring lock "cinder-quobyte-62182c0d-a830-4680-abcc-29ce1d811871" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Lock "cinder-quobyte-62182c0d-a830-4680-abcc-29ce1d811871" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8073399-277a-422b-a352-066fb2191c79]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:09 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 Jul 30 16:36:09 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:09 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 Jul 30 16:36:09 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:10 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1" returned: 0 in 0.859s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:10 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 1G Jul 30 16:36:10 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:10 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871" returned: 0 in 0.803s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:10 devstack sudo[90719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871 Jul 30 16:36:10 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:10 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-62182c0d-a830-4680-abcc-29ce1d811871" returned: 0 in 0.540s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Lock "cinder-quobyte-62182c0d-a830-4680-abcc-29ce1d811871" released by "delete_volume" :: held 1.427s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:10 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 1G" returned: 0 in 0.872s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:11 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 Jul 30 16:36:11 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Created reservations ['fea5c520-c3e7-421e-858d-2735ab6571d6', '4e3a30d8-f519-4c15-af58-afa93640e848', '6320708e-b048-490d-a45e-c8c3b3b99f21', 'bd81b3a0-d646-49e3-8e5c-ce6db0fc1a5d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Flow 'volume_create_manager' (9f383dd4-8c6b-45df-8aed-5249b4b862f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13455eb8-7516-414f-a6cc-c527e7884908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13455eb8-7516-414f-a6cc-c527e7884908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1974858716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df048df-4618-441d-922a-d896a655b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709a35922d604011897688e384183a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:11Z,use_quota=True,user_id='dd0ef2876b804823943386a248601fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a889f0e6-d80e-475a-bcfc-1a6c57689989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a889f0e6-d80e-475a-bcfc-1a6c57689989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d1192c-86b5-4ee2-b24f-520e06d49356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d1192c-86b5-4ee2-b24f-520e06d49356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df048df-4618-441d-922a-d896a655b118', 'volume_name': 'volume-9df048df-4618-441d-922a-d896a655b118', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d3d3a7-6a63-4c6e-af44-903cd69dd62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d3d3a7-6a63-4c6e-af44-903cd69dd62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378d684b-15eb-4510-85f0-03faad95751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:11 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Volume 9df048df-4618-441d-922a-d896a655b118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df048df-4618-441d-922a-d896a655b118', 'volume_size': 1} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-37d3acb9-ee4e-4084-abd0-058585c4ca56 tempest-VolumesActionsTest-1606428981 None] Terminate volume connection completed successfully. Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:11 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0" returned: 0 in 0.436s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:11 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:11 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:11 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:11 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 Jul 30 16:36:11 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37d3acb9-ee4e-4084-abd0-058585c4ca56 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-detach_volume" by "detach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37d3acb9-ee4e-4084-abd0-058585c4ca56 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-37d3acb9-ee4e-4084-abd0-058585c4ca56 tempest-VolumesActionsTest-1606428981 None] Detaching volume 8431ee1f-ec4e-47c8-9d31-117110e03df2 from instance 1e059e8f-ae88-447c-b570-fb04a57f2616. Jul 30 16:36:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-37d3acb9-ee4e-4084-abd0-058585c4ca56 tempest-VolumesActionsTest-1606428981 None] Detach volume completed successfully. Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37d3acb9-ee4e-4084-abd0-058585c4ca56 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:11 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Deleted volume successfully. Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-90dbd3e9-0ef9-4cb5-b304-f9241ab0d76f tempest-TaggedAttachmentsTest-641084452 None] Lock "cinder-62182c0d-a830-4680-abcc-29ce1d811871-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:11 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0" returned: 0 in 0.467s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:11 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info Jul 30 16:36:11 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4f85e44-3d16-4729-9367-b980f0415c7d tempest-VolumesActionsTest-1451078162 None] Acquiring lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-detach_volume" by "detach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4f85e44-3d16-4729-9367-b980f0415c7d tempest-VolumesActionsTest-1451078162 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a4f85e44-3d16-4729-9367-b980f0415c7d tempest-VolumesActionsTest-1451078162 None] Volume detach called, but volume not attached. Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4f85e44-3d16-4729-9367-b980f0415c7d tempest-VolumesActionsTest-1451078162 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:12 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Acquiring lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info" returned: 0 in 0.585s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:12 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:12 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info Jul 30 16:36:12 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Acquiring lock "cinder-quobyte-8431ee1f-ec4e-47c8-9d31-117110e03df2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Lock "cinder-quobyte-8431ee1f-ec4e-47c8-9d31-117110e03df2" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cb3ba6-4397-40cc-8af5-f3561d09acfe]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:12 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 Jul 30 16:36:12 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:13 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.info" returned: 0 in 0.533s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Acquiring lock "cinder-quobyte-5f499612-3628-41a7-9c04-997a1563f837" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-5f499612-3628-41a7-9c04-997a1563f837" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] snapshot: 778dded7-24e6-4268-bd6d-8ff025ed80a0, volume: 5f499612-3628-41a7-9c04-997a1563f837, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7aaebb-8bac-4a97-88ee-05ee532bc1ad]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:13 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2" returned: 0 in 0.638s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:13 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 Jul 30 16:36:13 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:13 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2 Jul 30 16:36:13 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:13 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8431ee1f-ec4e-47c8-9d31-117110e03df2" returned: 0 in 0.570s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Lock "cinder-quobyte-8431ee1f-ec4e-47c8-9d31-117110e03df2" released by "delete_volume" :: held 1.286s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:14 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0" returned: 0 in 0.947s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Created reservations ['f545800a-415a-41dd-9cc0-74f699fb5114', 'e7f9f926-96c2-4979-937e-9d10022670d0', '9d585606-2ec2-4793-a45a-25e66a33ade8', 'a29b327f-d307-45fe-9b0a-1ad0cae5ba6d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d15fdd-5699-4a37-8dfe-83367f609e7e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:14 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:14 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:14 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 Jul 30 16:36:14 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:14 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Deleted volume successfully. Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-659ecd11-86fa-458a-85bb-ef3628e2456f tempest-VolumesActionsTest-1451078162 None] Lock "cinder-8431ee1f-ec4e-47c8-9d31-117110e03df2-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:14 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1" returned: 0 in 0.659s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:36:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:14 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 Jul 30 16:36:14 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:22 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837" returned: 0 in 7.466s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:36:22 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Converted 1024.00 MB image at 137.13 MB/s Jul 30 16:36:22 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:22 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 Jul 30 16:36:22 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:22 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837" returned: 0 in 0.386s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-5f499612-3628-41a7-9c04-997a1563f837" released by "_copy_volume_from_snapshot" :: held 9.553s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Acquiring lock "cinder-quobyte-778dded7-24e6-4268-bd6d-8ff025ed80a0" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-778dded7-24e6-4268-bd6d-8ff025ed80a0" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Deleting offline snapshot 778dded7-24e6-4268-bd6d-8ff025ed80a0 of volume df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] snapshot_file for this snap is: volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa04038-208d-4261-81c5-251e6c559865]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:23 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 Jul 30 16:36:23 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (8f2818cc-54e9-47c5-93f6-d8d554419268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d5923b-7a27-4945-8913-003dc79913d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d5923b-7a27-4945-8913-003dc79913d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1907828880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b4a163-6977-419d-ba0d-e126a03526ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:23Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681aaf97-de53-43a1-9492-b2316bbc6b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681aaf97-de53-43a1-9492-b2316bbc6b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97006c4-de19-4a76-ae24-a1da18d6fb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97006c4-de19-4a76-ae24-a1da18d6fb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b4a163-6977-419d-ba0d-e126a03526ad', 'volume_name': 'volume-20b4a163-6977-419d-ba0d-e126a03526ad', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0678d78-3db9-46a3-8380-9f2c920beb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0678d78-3db9-46a3-8380-9f2c920beb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d5f79c-8e1d-4749-bd56-aaa0f5a5f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:23 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Volume 20b4a163-6977-419d-ba0d-e126a03526ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b4a163-6977-419d-ba0d-e126a03526ad', 'volume_size': 1} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:23 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0" returned: 0 in 0.463s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5f2e1-c669-41b6-81fa-ae5b9cdb778a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:23 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 Jul 30 16:36:23 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:23 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1" returned: 0 in 0.537s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:23 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 Jul 30 16:36:23 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:24 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:24 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0 Jul 30 16:36:24 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:24 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1.778dded7-24e6-4268-bd6d-8ff025ed80a0" returned: 0 in 0.252s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-778dded7-24e6-4268-bd6d-8ff025ed80a0" released by "_delete_snapshot" :: held 1.773s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.517s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.232s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1974858716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df048df-4618-441d-922a-d896a655b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709a35922d604011897688e384183a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:11Z,use_quota=True,user_id='dd0ef2876b804823943386a248601fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Creating volume 9df048df-4618-441d-922a-d896a655b118 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:24 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:24 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 1073741824 Jul 30 16:36:24 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a36213df-5926-4520-9fc6-6c7446163bee tempest-GroupsV314Test-1613749262 None] Create group from source-group-b12340ef-7cd6-4bd6-b72a-a235fc39e959 completed successfully. Jul 30 16:36:24 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 1073741824" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:25 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 Jul 30 16:36:25 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:25 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118" returned: 0 in 0.235s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.034s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1907828880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b4a163-6977-419d-ba0d-e126a03526ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:23Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Creating volume 20b4a163-6977-419d-ba0d-e126a03526ad {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:25 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378d684b-15eb-4510-85f0-03faad95751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df048df-4618-441d-922a-d896a655b118', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:25 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad 1073741824 Jul 30 16:36:25 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78293d37-5e59-41a9-bb62-3249b5ddda4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:25 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Volume volume-9df048df-4618-441d-922a-d896a655b118 (9df048df-4618-441d-922a-d896a655b118): created successfully Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78293d37-5e59-41a9-bb62-3249b5ddda4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Flow 'volume_create_manager' (9f383dd4-8c6b-45df-8aed-5249b4b862f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f1fcef10-4c0c-4467-80d0-ed50e4e482ee tempest-VolumesAdminNegativeTest-1336155745 None] Created volume successfully. Jul 30 16:36:25 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad 1073741824" returned: 0 in 0.470s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:25 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad Jul 30 16:36:25 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:26 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad" returned: 0 in 0.435s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Acquiring lock "cinder-quobyte-5f499612-3628-41a7-9c04-997a1563f837" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d5f79c-8e1d-4749-bd56-aaa0f5a5f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b4a163-6977-419d-ba0d-e126a03526ad', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba99de0-a219-441a-9221-dba16edfffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:26 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Volume volume-20b4a163-6977-419d-ba0d-e126a03526ad (20b4a163-6977-419d-ba0d-e126a03526ad): created successfully Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba99de0-a219-441a-9221-dba16edfffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (8f2818cc-54e9-47c5-93f6-d8d554419268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-5f499612-3628-41a7-9c04-997a1563f837" acquired by "delete_volume" :: waited 0.054s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0db080f8-ceac-467e-8249-3144804aebf1 tempest-VolumesActionsTest-1451078162 None] Created volume successfully. Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf965aa-6ed6-4ffc-a3f5-29a4164464b6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:26 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 Jul 30 16:36:26 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Acquiring lock "cinder-9df048df-4618-441d-922a-d896a655b118-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Lock "cinder-9df048df-4618-441d-922a-d896a655b118-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Acquiring lock "cinder-quobyte-9df048df-4618-441d-922a-d896a655b118" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Lock "cinder-quobyte-9df048df-4618-441d-922a-d896a655b118" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[483d4d4c-c1d2-4f87-963f-f34b118bb064]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:26 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:26 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837 Jul 30 16:36:26 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:26 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 Jul 30 16:36:26 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:27 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5f499612-3628-41a7-9c04-997a1563f837" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-5f499612-3628-41a7-9c04-997a1563f837" released by "delete_volume" :: held 0.823s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:27 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118" returned: 0 in 0.496s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Created reservations ['4157d81e-baf2-42ad-b32b-88deb1855e23'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:27 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118 Jul 30 16:36:27 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:27 devstack cinder-volume[88380]: WARNING cinder.quota [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1129964221 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1129964221, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:36:27 devstack cinder-volume[88380]: WARNING cinder.quota [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1129964221 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1129964221, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Created reservations ['68b7e56c-733f-4ad7-a5c6-fd1e4055c21a', '7f1135ef-c2e2-49e3-a4a4-c1883e56b9de', '543d23ab-b6c0-4d40-8226-3311159c4542', 'd87d82bb-df76-418d-8403-7952f485e06f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:27 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:27 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-20b4a163-6977-419d-ba0d-e126a03526ad-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Lock "cinder-20b4a163-6977-419d-ba0d-e126a03526ad-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:27 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9df048df-4618-441d-922a-d896a655b118" returned: 0 in 0.342s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Lock "cinder-quobyte-9df048df-4618-441d-922a-d896a655b118" released by "delete_volume" :: held 0.884s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-quobyte-20b4a163-6977-419d-ba0d-e126a03526ad" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-20b4a163-6977-419d-ba0d-e126a03526ad" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0796a0-b9c0-46cf-b8f5-d68c4c142a82]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Created reservations ['ba1861a1-31c1-4842-89cf-b0993830c161', '2c2536fd-fa61-411f-b918-9ab0341d043d', '4ae5d45d-d013-46e2-957d-724b3a526b20', 'b8e1b74b-9cbc-40b8-bced-c7b59fab88bb'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:27 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.382s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:27 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b34a5f6c-65ba-4ddd-ae1f-70f6da7540db tempest-GroupsV314Test-1613749262 None] Delete group completed successfully. Jul 30 16:36:27 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:27 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:27 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad Jul 30 16:36:27 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Acquiring lock "cinder-quobyte-df36c1f5-36b5-41d3-ae1f-e535c22055e1" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-df36c1f5-36b5-41d3-ae1f-e535c22055e1" acquired by "delete_volume" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ff035-8d50-453d-9ae9-cd8a241a8d30]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:28 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.554s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:28 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Deleted volume successfully. Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ecffc6a5-0d32-46fa-af0e-74622ca920a8 tempest-VolumesAdminNegativeTest-1336155745 None] Lock "cinder-9df048df-4618-441d-922a-d896a655b118-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:28 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad" returned: 0 in 0.735s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:28 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 Jul 30 16:36:28 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:28 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad Jul 30 16:36:28 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:28 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-20b4a163-6977-419d-ba0d-e126a03526ad" returned: 0 in 0.390s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-20b4a163-6977-419d-ba0d-e126a03526ad" released by "delete_volume" :: held 1.196s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:28 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1" returned: 0 in 0.730s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:28 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1 Jul 30 16:36:28 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:28 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Created reservations ['ecd3b6f2-3fd6-4207-9ad8-bc38c0baf1cb', '9bb32792-f3f7-4963-b0ac-0b97eb36fd79', '21f9b155-6c8d-4ef6-9f44-c725b1f157fd', '484c1425-9fd1-4ae7-ac18-dd28cce60706'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:29 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:29 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:29 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-df36c1f5-36b5-41d3-ae1f-e535c22055e1" returned: 0 in 0.351s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Lock "cinder-quobyte-df36c1f5-36b5-41d3-ae1f-e535c22055e1" released by "delete_volume" :: held 1.218s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Created reservations ['a73a4090-0c7d-423a-9222-681928f80a06'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:29 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.331s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Deleted volume successfully. Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f9e90ba-7973-4939-a76b-5a7b0ac0313d tempest-VolumesActionsTest-1606428981 None] Lock "cinder-20b4a163-6977-419d-ba0d-e126a03526ad-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Created reservations ['050e6299-7ef0-4fad-bb55-79f8660332b3', 'bfcfc10c-a2e6-4c31-8361-584308417f15', 'fc69328e-429e-4949-b640-a922193d1bb9', '5925644d-7042-4f6a-b1e7-ac3b46e2a34e'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:29 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:29 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:30 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.334s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:30 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4ebb0aa4-d427-43ff-99db-e3180647f323 tempest-GroupsV314Test-1613749262 None] Delete group completed successfully. Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (c980a970-6ccd-4ff3-9d96-b6aff2b8a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d25c7a3-9e3a-4ab3-889a-e14d8072da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d25c7a3-9e3a-4ab3-889a-e14d8072da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-543277407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f15c538-0914-466d-b5bd-4216a58d7aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:31Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6e8306-a659-43c5-af98-2f65e8b139b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6e8306-a659-43c5-af98-2f65e8b139b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2202d7eb-28de-464e-b828-b8a5c040d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2202d7eb-28de-464e-b828-b8a5c040d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f15c538-0914-466d-b5bd-4216a58d7aa8', 'volume_name': 'volume-8f15c538-0914-466d-b5bd-4216a58d7aa8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968ac7b5-7bd8-4736-9738-eae2dc0b3d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968ac7b5-7bd8-4736-9738-eae2dc0b3d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f09233-0546-4176-972b-3bdb91bf8cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:30 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Volume 8f15c538-0914-466d-b5bd-4216a58d7aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f15c538-0914-466d-b5bd-4216a58d7aa8', 'volume_size': 1} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-543277407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f15c538-0914-466d-b5bd-4216a58d7aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:31Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Creating volume 8f15c538-0914-466d-b5bd-4216a58d7aa8 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:30 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:30 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 1073741824 Jul 30 16:36:30 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:31 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 1073741824" returned: 0 in 0.633s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:31 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 Jul 30 16:36:31 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:31 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f09233-0546-4176-972b-3bdb91bf8cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f15c538-0914-466d-b5bd-4216a58d7aa8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c4078d-4b02-442c-a9b8-b03562ed431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Volume volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 (8f15c538-0914-466d-b5bd-4216a58d7aa8): created successfully Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c4078d-4b02-442c-a9b8-b03562ed431f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (c980a970-6ccd-4ff3-9d96-b6aff2b8a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d1b17bbe-0dbb-4cd9-9571-9e82e1ebe5d7 tempest-VolumesActionsTest-1451078162 None] Created volume successfully. Jul 30 16:36:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-8f15c538-0914-466d-b5bd-4216a58d7aa8-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-8f15c538-0914-466d-b5bd-4216a58d7aa8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-quobyte-8f15c538-0914-466d-b5bd-4216a58d7aa8" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-8f15c538-0914-466d-b5bd-4216a58d7aa8" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:32 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f364b92f-01a2-403d-89fa-934877fa4111]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:33 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 Jul 30 16:36:33 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:33 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8" returned: 0 in 0.395s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:33 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8 Jul 30 16:36:33 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:33 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8f15c538-0914-466d-b5bd-4216a58d7aa8" returned: 0 in 0.270s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-8f15c538-0914-466d-b5bd-4216a58d7aa8" released by "delete_volume" :: held 0.716s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Created reservations ['4a7e0508-0244-48c2-9d2e-4911d380d156', '5b55a498-82f2-4576-a593-4f5859e8a27d', '270a75d3-a5d6-499c-9e18-a6fc4f834166', '509f0309-e630-4533-bc01-3675ae47f15c'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:33 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:33 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:34 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:34 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Deleted volume successfully. Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-171fea75-9c8e-44ae-9be0-7a5e3cc8b958 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-8f15c538-0914-466d-b5bd-4216a58d7aa8-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (4ab3ded1-0d2e-4afb-9e6d-d44384885484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b365f4-74b0-43c4-94ad-bacf5e14162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b365f4-74b0-43c4-94ad-bacf5e14162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-194327401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fdda70-c480-46a5-8021-4195581888b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:35Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04d94c1-2dff-4948-95d7-c7a63d8442a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04d94c1-2dff-4948-95d7-c7a63d8442a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb43d3f0-178b-4e67-a0cb-8c85ffa0c61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb43d3f0-178b-4e67-a0cb-8c85ffa0c61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fdda70-c480-46a5-8021-4195581888b4', 'volume_name': 'volume-e2fdda70-c480-46a5-8021-4195581888b4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97711889-c1c6-4e28-a8df-8457cc1193f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97711889-c1c6-4e28-a8df-8457cc1193f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5768e5c-bbb2-4f8a-bd79-3244b1bd0623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Volume e2fdda70-c480-46a5-8021-4195581888b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fdda70-c480-46a5-8021-4195581888b4', 'volume_size': 1} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-194327401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fdda70-c480-46a5-8021-4195581888b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:35Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Creating volume e2fdda70-c480-46a5-8021-4195581888b4 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:34 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:34 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 1073741824 Jul 30 16:36:34 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:35 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 1073741824" returned: 0 in 0.577s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:35 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 Jul 30 16:36:35 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:35 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4" returned: 0 in 0.303s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5768e5c-bbb2-4f8a-bd79-3244b1bd0623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fdda70-c480-46a5-8021-4195581888b4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37a5a0a-622e-43f7-8957-a10779fbfb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Volume volume-e2fdda70-c480-46a5-8021-4195581888b4 (e2fdda70-c480-46a5-8021-4195581888b4): created successfully Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37a5a0a-622e-43f7-8957-a10779fbfb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (4ab3ded1-0d2e-4afb-9e6d-d44384885484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2e0468d7-d46e-452c-a13c-0eea36c6aa02 tempest-VolumesActionsTest-1451078162 None] Created volume successfully. Jul 30 16:36:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-e2fdda70-c480-46a5-8021-4195581888b4-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-e2fdda70-c480-46a5-8021-4195581888b4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-quobyte-e2fdda70-c480-46a5-8021-4195581888b4" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-e2fdda70-c480-46a5-8021-4195581888b4" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dfb3b3-8e32-44f7-84e7-ac5d8c843e17]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:37 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 Jul 30 16:36:37 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:37 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4" returned: 0 in 0.462s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:37 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4 Jul 30 16:36:37 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:37 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e2fdda70-c480-46a5-8021-4195581888b4" returned: 0 in 0.388s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-e2fdda70-c480-46a5-8021-4195581888b4" released by "delete_volume" :: held 0.914s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Created reservations ['5e0c1ebd-aa84-4fc6-8ecd-5c90c8461bed', 'c9cd2b58-f2f7-4cf6-87d1-eba3187d297e', '7f4876bf-9c18-4a85-9a0c-ec94ddd8faa6', 'b34970dc-53db-4743-b40e-683ab7bee332'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:38 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:38 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:38 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.346s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Deleted volume successfully. Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bd8fdd9c-a84f-46d9-8771-ee38a6753d04 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-e2fdda70-c480-46a5-8021-4195581888b4-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (b0f54584-028f-400f-8591-274dcb500d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f13c54-edb7-4b2b-9ba1-d30812e64485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f13c54-edb7-4b2b-9ba1-d30812e64485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48519973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec478bf8-dd44-4d84-b052-a2340d3c0de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:39Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8ec886-ab27-4783-9b75-617e229851db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8ec886-ab27-4783-9b75-617e229851db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ace1b76-93d8-4f77-b615-a640263d96cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ace1b76-93d8-4f77-b615-a640263d96cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec478bf8-dd44-4d84-b052-a2340d3c0de7', 'volume_name': 'volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b46d1b8-3c9e-4d2c-98f2-8f98344cfc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b46d1b8-3c9e-4d2c-98f2-8f98344cfc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1919365c-8c1a-4b3a-9711-3b3638faf1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Volume ec478bf8-dd44-4d84-b052-a2340d3c0de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7', 'volume_size': 1} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48519973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec478bf8-dd44-4d84-b052-a2340d3c0de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:39Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Creating volume ec478bf8-dd44-4d84-b052-a2340d3c0de7 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:39 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:39 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 1073741824 Jul 30 16:36:39 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:39 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 1073741824" returned: 0 in 0.596s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:39 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 Jul 30 16:36:39 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:40 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7" returned: 0 in 0.365s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1919365c-8c1a-4b3a-9711-3b3638faf1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05c63f8-aa55-4ac6-80aa-cbcba3c6f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Volume volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 (ec478bf8-dd44-4d84-b052-a2340d3c0de7): created successfully Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05c63f8-aa55-4ac6-80aa-cbcba3c6f20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (b0f54584-028f-400f-8591-274dcb500d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:40 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6e19f79b-4d9a-4949-ab96-3075755bc19c tempest-VolumesActionsTest-1451078162 None] Created volume successfully. Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-ec478bf8-dd44-4d84-b052-a2340d3c0de7-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-ec478bf8-dd44-4d84-b052-a2340d3c0de7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "cinder-quobyte-ec478bf8-dd44-4d84-b052-a2340d3c0de7" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-ec478bf8-dd44-4d84-b052-a2340d3c0de7" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd46686-fb58-401c-8db3-b44b0ca079af]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:41 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 Jul 30 16:36:41 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:41 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7" returned: 0 in 0.433s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:41 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7 Jul 30 16:36:41 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:42 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ec478bf8-dd44-4d84-b052-a2340d3c0de7" returned: 0 in 0.445s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-quobyte-ec478bf8-dd44-4d84-b052-a2340d3c0de7" released by "delete_volume" :: held 0.935s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Created reservations ['7369a704-de24-44e6-b86a-c30e4efa79e1', 'd9e03457-ec9b-400c-8d23-173a26cdfc91', '49440992-6dbe-4aad-a8c5-6c88194d9722', '03de0ca4-21ef-4694-92a5-923b5a0079f2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:42 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:42 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:42 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.393s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:42 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Deleted volume successfully. Jul 30 16:36:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e3a58844-059e-4edc-a15e-c903b2f209e1 tempest-VolumesActionsTest-1606428981 None] Lock "cinder-ec478bf8-dd44-4d84-b052-a2340d3c0de7-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (267760d2-44df-4f88-b098-171aba765690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe1c0b3-c7cf-4592-93b8-432a7c676d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe1c0b3-c7cf-4592-93b8-432a7c676d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-268917181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd113f1-f4e4-491d-952b-f97224bae67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:44Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f32a203-2ebd-4a0e-9eb4-4642138d4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f32a203-2ebd-4a0e-9eb4-4642138d4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b788a8cc-b6df-4040-92cf-aaa65c0b2660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b788a8cc-b6df-4040-92cf-aaa65c0b2660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd113f1-f4e4-491d-952b-f97224bae67d', 'volume_name': 'volume-2cd113f1-f4e4-491d-952b-f97224bae67d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35013820-ea0f-49eb-9354-8f42e0737e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35013820-ea0f-49eb-9354-8f42e0737e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84842e85-3aec-4422-a99b-945d74dd802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Volume 2cd113f1-f4e4-491d-952b-f97224bae67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd113f1-f4e4-491d-952b-f97224bae67d', 'volume_size': 1} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-268917181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd113f1-f4e4-491d-952b-f97224bae67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1cabc19de34449ca50364616188e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:36:44Z,use_quota=True,user_id='31c6689cdd1941eea0574ccd28465cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Creating volume 2cd113f1-f4e4-491d-952b-f97224bae67d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:36:44 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:44 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d 1073741824 Jul 30 16:36:44 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:44 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d 1073741824" returned: 0 in 0.549s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:45 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d Jul 30 16:36:45 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:45 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d" returned: 0 in 0.307s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84842e85-3aec-4422-a99b-945d74dd802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd113f1-f4e4-491d-952b-f97224bae67d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7da0349-f777-4634-a0b3-63a005ca7200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:36:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Volume volume-2cd113f1-f4e4-491d-952b-f97224bae67d (2cd113f1-f4e4-491d-952b-f97224bae67d): created successfully Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7da0349-f777-4634-a0b3-63a005ca7200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:36:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Flow 'volume_create_manager' (267760d2-44df-4f88-b098-171aba765690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:36:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-97f96721-8be9-49e7-96eb-0a2db360428f tempest-VolumesActionsTest-1451078162 None] Created volume successfully. Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "cinder-2cd113f1-f4e4-491d-952b-f97224bae67d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Lock "cinder-2cd113f1-f4e4-491d-952b-f97224bae67d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "cinder-quobyte-2cd113f1-f4e4-491d-952b-f97224bae67d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Lock "cinder-quobyte-2cd113f1-f4e4-491d-952b-f97224bae67d" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d736840-4841-4e66-b0cc-7611ead5c41d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:47 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d Jul 30 16:36:47 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:47 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:47 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d Jul 30 16:36:47 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:48 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2cd113f1-f4e4-491d-952b-f97224bae67d" returned: 0 in 0.295s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Lock "cinder-quobyte-2cd113f1-f4e4-491d-952b-f97224bae67d" released by "delete_volume" :: held 0.837s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Created reservations ['f94d0c75-ee5f-465f-9ad3-7b082bfa6787', '3562c590-e7a5-48d0-85ac-7621cee4cb52', '03cff6dc-b675-4956-86ea-bb169efe97d4', 'f1045bc3-65bc-40d4-a30e-4ed87b71b745'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:48 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:48 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:48 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.450s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Deleted volume successfully. Jul 30 16:36:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b9f79e76-1d0b-44bc-9996-805eefd8c3a8 tempest-VolumesActionsTest-1451078162 None] Lock "cinder-2cd113f1-f4e4-491d-952b-f97224bae67d-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:36:54 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:36:54 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:36:54 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 8 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:36:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:36:58 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=93,cinder:UPDATE=120,cinder:INSERT=27,cinder:DELETE=9 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:36:58 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=84,cinder:UPDATE=115,cinder:INSERT=27,cinder:DELETE=7 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Flow 'volume_create_manager' (54211d8a-f692-4309-8e2b-c601ead78bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d606121b-c158-42b1-a5f3-716d3509aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d606121b-c158-42b1-a5f3-716d3509aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1578609923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5d792c-366c-4788-aef6-686d03569919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18d1c6e319f4e619b9dd2907ca668aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:00Z,use_quota=True,user_id='24994e89259b48a4ad44db72511c3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe11cbba-fa5c-4ba3-9603-4a221db177db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe11cbba-fa5c-4ba3-9603-4a221db177db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae75938-06ac-4e2c-ad2a-fd30868639df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae75938-06ac-4e2c-ad2a-fd30868639df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5d792c-366c-4788-aef6-686d03569919', 'volume_name': 'volume-fa5d792c-366c-4788-aef6-686d03569919', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff51733-e956-4032-ba99-77285488e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff51733-e956-4032-ba99-77285488e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af0e1d9-b2a7-44e0-b955-5e00ce900ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:00 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Volume fa5d792c-366c-4788-aef6-686d03569919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5d792c-366c-4788-aef6-686d03569919', 'volume_size': 1} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1578609923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5d792c-366c-4788-aef6-686d03569919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18d1c6e319f4e619b9dd2907ca668aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:00Z,use_quota=True,user_id='24994e89259b48a4ad44db72511c3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Creating volume fa5d792c-366c-4788-aef6-686d03569919 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:00 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:00 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 1073741824 Jul 30 16:37:00 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:01 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 1073741824" returned: 0 in 0.668s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:01 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 Jul 30 16:37:01 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:01 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919" returned: 0 in 0.610s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af0e1d9-b2a7-44e0-b955-5e00ce900ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5d792c-366c-4788-aef6-686d03569919', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1349d76b-8629-41ff-8b80-f9029a5870a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:01 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Volume volume-fa5d792c-366c-4788-aef6-686d03569919 (fa5d792c-366c-4788-aef6-686d03569919): created successfully Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1349d76b-8629-41ff-8b80-f9029a5870a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Flow 'volume_create_manager' (54211d8a-f692-4309-8e2b-c601ead78bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1139ec86-b48f-49b5-8859-991791a82bb8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Created volume successfully. Jul 30 16:37:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "cinder-fa5d792c-366c-4788-aef6-686d03569919-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "cinder-fa5d792c-366c-4788-aef6-686d03569919-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "cinder-quobyte-fa5d792c-366c-4788-aef6-686d03569919" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "cinder-quobyte-fa5d792c-366c-4788-aef6-686d03569919" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec2dc9-2685-4733-991f-17adf592dfac]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:03 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 Jul 30 16:37:03 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:03 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919" returned: 0 in 0.443s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:03 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919 Jul 30 16:37:03 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:03 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fa5d792c-366c-4788-aef6-686d03569919" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "cinder-quobyte-fa5d792c-366c-4788-aef6-686d03569919" released by "delete_volume" :: held 0.866s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Created reservations ['9943b562-7d7c-46f2-9861-e44c2a547293', 'ff8bf86a-5610-487a-8b57-c6255e6ccf92', '17edcee0-95ce-4561-8e67-2c501d55ac02', 'd31298ed-5ff4-4ae4-b42f-3d291e7d0928'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:04 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:04 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:04 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.415s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Deleted volume successfully. Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9bd86c91-be5d-4557-b6af-1171bce9ddc8 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "cinder-fa5d792c-366c-4788-aef6-686d03569919-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Flow 'volume_create_manager' (d1f29a6f-2a84-44b4-a5e6-331c0066d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f912b2-e55c-4f84-b4bb-ea2ee36757cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f912b2-e55c-4f84-b4bb-ea2ee36757cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-392972112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bbc41c-4ac5-4ef5-a4f5-add066546898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18d1c6e319f4e619b9dd2907ca668aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:05Z,use_quota=True,user_id='24994e89259b48a4ad44db72511c3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41531ad5-2fc3-4678-98bd-f4bf57aac41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41531ad5-2fc3-4678-98bd-f4bf57aac41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f7d35c-b96b-4034-a19f-d020538ecb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f7d35c-b96b-4034-a19f-d020538ecb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5bbc41c-4ac5-4ef5-a4f5-add066546898', 'volume_name': 'volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0aa4d3-23d5-4bb5-ada2-4ad5c9c1c4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0aa4d3-23d5-4bb5-ada2-4ad5c9c1c4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148f2a2b-cfc7-4b52-83aa-b80cc299ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:05 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Volume d5bbc41c-4ac5-4ef5-a4f5-add066546898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898', 'volume_size': 1} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-392972112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5bbc41c-4ac5-4ef5-a4f5-add066546898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18d1c6e319f4e619b9dd2907ca668aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:05Z,use_quota=True,user_id='24994e89259b48a4ad44db72511c3898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Creating volume d5bbc41c-4ac5-4ef5-a4f5-add066546898 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:05 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:05 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 1073741824 Jul 30 16:37:05 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:05 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 1073741824" returned: 0 in 0.670s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:05 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 Jul 30 16:37:05 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:06 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898" returned: 0 in 0.383s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148f2a2b-cfc7-4b52-83aa-b80cc299ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a95167-6915-497e-9b44-e403a650ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Volume volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 (d5bbc41c-4ac5-4ef5-a4f5-add066546898): created successfully Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a95167-6915-497e-9b44-e403a650ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Flow 'volume_create_manager' (d1f29a6f-2a84-44b4-a5e6-331c0066d67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a1a7c65b-9b5f-434d-9dc3-c26c82964d64 tempest-VolumeQuotasAdminTestJSON-475987080 None] Created volume successfully. Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Flow 'volume_create_manager' (6eab5e29-c754-402d-8e1a-0d3e824d2133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccbfd7c-8b4a-4c0a-921c-1498a50886f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccbfd7c-8b4a-4c0a-921c-1498a50886f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-737696546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334aa5ab-1012-4f6c-a366-e58c4541cbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6170c13554884de5a2cd3f73f6188f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:08Z,use_quota=True,user_id='1278bc56bbb5455292d2e9fcfc9d0bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529705d9-59a9-4afa-abc3-de9ed3bcac13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529705d9-59a9-4afa-abc3-de9ed3bcac13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2e91bb-52cc-4205-b0f8-0dc55e07a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2e91bb-52cc-4205-b0f8-0dc55e07a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334aa5ab-1012-4f6c-a366-e58c4541cbd5', 'volume_name': 'volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79bb1b4-c01a-4081-b95f-9908ce6ae00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79bb1b4-c01a-4081-b95f-9908ce6ae00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51363893-e913-4460-b34d-0a87f6765157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Volume 334aa5ab-1012-4f6c-a366-e58c4541cbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5', 'volume_size': 1} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-737696546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334aa5ab-1012-4f6c-a366-e58c4541cbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6170c13554884de5a2cd3f73f6188f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:08Z,use_quota=True,user_id='1278bc56bbb5455292d2e9fcfc9d0bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Creating volume 334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:08 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:08 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 1073741824 Jul 30 16:37:08 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8da2d901-25fc-40d3-9264-13071eb536b1 tempest-VolumeQuotasAdminTestJSON-537583486 None] Transfer volume completed successfully. Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Acquiring lock "cinder-d5bbc41c-4ac5-4ef5-a4f5-add066546898-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Lock "cinder-d5bbc41c-4ac5-4ef5-a4f5-add066546898-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:09 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 1073741824" returned: 0 in 0.865s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Acquiring lock "cinder-quobyte-d5bbc41c-4ac5-4ef5-a4f5-add066546898" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Lock "cinder-quobyte-d5bbc41c-4ac5-4ef5-a4f5-add066546898" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8e76d-537e-4578-872b-17e27c32481e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:09 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 Jul 30 16:37:09 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:09 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 Jul 30 16:37:09 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:09 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5" returned: 0 in 0.451s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51363893-e913-4460-b34d-0a87f6765157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c3e973-3615-470c-a860-83f44b21702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:09 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Volume volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 (334aa5ab-1012-4f6c-a366-e58c4541cbd5): created successfully Jul 30 16:37:09 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c3e973-3615-470c-a860-83f44b21702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Flow 'volume_create_manager' (6eab5e29-c754-402d-8e1a-0d3e824d2133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898" returned: 0 in 0.557s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-95e2da18-3b0c-4eb1-8243-20bae08dcadf tempest-SnapshotMetadataTestJSON-12434157 None] Created volume successfully. Jul 30 16:37:09 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898 Jul 30 16:37:09 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:10 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d5bbc41c-4ac5-4ef5-a4f5-add066546898" returned: 0 in 0.526s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Lock "cinder-quobyte-d5bbc41c-4ac5-4ef5-a4f5-add066546898" released by "delete_volume" :: held 1.163s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Created reservations ['90c97afc-8920-4b2d-912c-026e1bc2f725', '779486f8-5395-4c2f-80e5-23854b04f4f5', '979afb64-7b83-4708-9f8c-bdf90f4aec6f', '5c2f28ba-31c0-4565-9015-57a8210fe742'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Creating offline snapshot 51100977-ac9e-4ed1-908e-c5e61438695a of volume 334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[125dc711-efa8-4213-a6a7-c20cb45129ca]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:10 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:10 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:10 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 Jul 30 16:37:10 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:11 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Deleted volume successfully. Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ae75632e-54ea-4d57-865d-978695095f44 tempest-VolumeQuotasAdminTestJSON-1114265095 None] Lock "cinder-d5bbc41c-4ac5-4ef5-a4f5-add066546898-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:11 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5" returned: 0 in 0.517s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:11 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a 1G Jul 30 16:37:11 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:11 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a 1G" returned: 0 in 0.532s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:11 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a Jul 30 16:37:11 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:12 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a" returned: 0 in 0.314s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:12 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a is being set with open permissions: ugo+rw Jul 30 16:37:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:12 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a Jul 30 16:37:12 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:12 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a" returned: 0 in 0.287s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:12 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info Jul 30 16:37:12 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:12 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info" returned: 0 in 0.366s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:12 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info is being set with open permissions: ugo+rw Jul 30 16:37:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:12 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info Jul 30 16:37:12 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:13 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.info" returned: 0 in 0.304s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:13 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d81b180c-0465-4dec-be52-7b119c870831 tempest-SnapshotMetadataTestJSON-12434157 None] Create snapshot completed successfully Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "cinder-51100977-ac9e-4ed1-908e-c5e61438695a-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-51100977-ac9e-4ed1-908e-c5e61438695a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "cinder-quobyte-334aa5ab-1012-4f6c-a366-e58c4541cbd5" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-quobyte-334aa5ab-1012-4f6c-a366-e58c4541cbd5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "cinder-quobyte-51100977-ac9e-4ed1-908e-c5e61438695a" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-quobyte-51100977-ac9e-4ed1-908e-c5e61438695a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Deleting offline snapshot 51100977-ac9e-4ed1-908e-c5e61438695a of volume 334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] snapshot_file for this snap is: volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[650e9364-e424-492f-96ed-80a9340217f0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:14 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a Jul 30 16:37:14 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:15 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a" returned: 0 in 0.451s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e02e8f-c432-461a-b00f-c83e9fb8e638]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:15 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 Jul 30 16:37:15 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:15 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5" returned: 0 in 0.420s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:15 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a Jul 30 16:37:15 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:15 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a" returned: 0 in 0.393s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:15 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a Jul 30 16:37:15 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:16 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5.51100977-ac9e-4ed1-908e-c5e61438695a" returned: 0 in 0.335s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-quobyte-51100977-ac9e-4ed1-908e-c5e61438695a" released by "_delete_snapshot" :: held 1.752s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-quobyte-334aa5ab-1012-4f6c-a366-e58c4541cbd5" released by "delete_snapshot" :: held 1.782s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Created reservations ['6fd291d4-70ad-43c2-9d5a-cfb553fbae0d', '74d2c8aa-114e-4634-82a2-17018f60b88c', 'a5298f4d-c5b5-4dd3-bbda-449d581c7f52', 'ebe8d4a5-4192-4d46-8bc8-fb965b1a5e42'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Delete snapshot completed successfully. Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e9dac425-affe-47ea-b0e0-d3024e2c21a4 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-51100977-ac9e-4ed1-908e-c5e61438695a-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "cinder-334aa5ab-1012-4f6c-a366-e58c4541cbd5-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-334aa5ab-1012-4f6c-a366-e58c4541cbd5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "cinder-quobyte-334aa5ab-1012-4f6c-a366-e58c4541cbd5" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-quobyte-334aa5ab-1012-4f6c-a366-e58c4541cbd5" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5c93ea-5f2b-4c4e-b348-90e9908771e4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:17 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 Jul 30 16:37:17 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:17 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5" returned: 0 in 0.512s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:17 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5 Jul 30 16:37:17 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:17 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-334aa5ab-1012-4f6c-a366-e58c4541cbd5" returned: 0 in 0.263s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-quobyte-334aa5ab-1012-4f6c-a366-e58c4541cbd5" released by "delete_volume" :: held 0.859s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Created reservations ['9b35ed40-a088-402b-b305-196fdfd4be64', '6d2f4bf5-3193-44f4-8247-c8d7d692cea2', 'afafbc34-fb7b-4655-a4ce-cef6159a1fd4', 'cb8efa8f-c361-48fc-add4-578098d0d77e'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:17 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:17 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:18 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.379s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:18 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Deleted volume successfully. Jul 30 16:37:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e0aff4b-b425-4449-869b-d4c0a73196c0 tempest-SnapshotMetadataTestJSON-12434157 None] Lock "cinder-334aa5ab-1012-4f6c-a366-e58c4541cbd5-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Flow 'volume_create_manager' (1a278646-bb07-41d2-9d9f-76817cc05f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee78f39-f7ec-4723-b314-476a5b4b456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee78f39-f7ec-4723-b314-476a5b4b456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-368814033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0f3f94b4b847169ce938087d199c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:21Z,use_quota=True,user_id='8c36f32b286f4eef833b42d95c677912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54437f9e-69c0-46f6-8686-5e9cca55f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54437f9e-69c0-46f6-8686-5e9cca55f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2614cee0-f511-4553-abff-0134ed45a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2614cee0-f511-4553-abff-0134ed45a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0', 'volume_name': 'volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9889f34d-a9ed-4997-890c-a61a0431501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9889f34d-a9ed-4997-890c-a61a0431501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f2ed8d-ae79-412a-9bc6-b7e72f4afa2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:21 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Volume ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0', 'volume_size': 1} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-368814033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0f3f94b4b847169ce938087d199c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:21Z,use_quota=True,user_id='8c36f32b286f4eef833b42d95c677912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Creating volume ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:21 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:21 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 1073741824 Jul 30 16:37:21 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:21 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 1073741824" returned: 0 in 0.559s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:21 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 Jul 30 16:37:21 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:22 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0" returned: 0 in 0.331s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f2ed8d-ae79-412a-9bc6-b7e72f4afa2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95a4b85-0252-4869-bb9d-9ed037f1b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:22 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Volume volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 (ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0): created successfully Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95a4b85-0252-4869-bb9d-9ed037f1b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Flow 'volume_create_manager' (1a278646-bb07-41d2-9d9f-76817cc05f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-96d1f034-607a-44b0-b076-b147d09a40dd tempest-VolumesServicesTestJSON-1067697100 None] Created volume successfully. Jul 30 16:37:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Acquiring lock "cinder-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Lock "cinder-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Acquiring lock "cinder-quobyte-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Lock "cinder-quobyte-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0" acquired by "delete_volume" :: waited 0.045s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:23 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Flow 'volume_create_manager' (6767be62-2d6f-4f8f-bfad-f629d90e4631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba25a2d-499b-4cd8-8343-a96d44ee81fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f839cf-a1ac-408e-8f17-fd4c1d723386]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba25a2d-499b-4cd8-8343-a96d44ee81fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1928265414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f40afd9-add8-4848-bd0e-f58e1f9f4e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8fac75e84834ff5988a7f0cba96f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:24Z,use_quota=True,user_id='4c31164d807a4c7c9b400ed2ca2e5c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccaadd78-3ddc-4487-97a4-0ad98349c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccaadd78-3ddc-4487-97a4-0ad98349c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1425b0b6-05eb-405f-be0f-8ee0b1c5a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1425b0b6-05eb-405f-be0f-8ee0b1c5a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f40afd9-add8-4848-bd0e-f58e1f9f4e5a', 'volume_name': 'volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6833ddfa-e9c2-4d1c-8aba-ec6bb5dad93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6833ddfa-e9c2-4d1c-8aba-ec6bb5dad93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 Jul 30 16:37:24 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c662a51-d943-4953-b38f-0c2bc16dd309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Volume 3f40afd9-add8-4848-bd0e-f58e1f9f4e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a', 'volume_size': 1} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1928265414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f40afd9-add8-4848-bd0e-f58e1f9f4e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8fac75e84834ff5988a7f0cba96f0f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:24Z,use_quota=True,user_id='4c31164d807a4c7c9b400ed2ca2e5c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Creating volume 3f40afd9-add8-4848-bd0e-f58e1f9f4e5a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:24 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:24 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a 1073741824 Jul 30 16:37:24 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Flow 'volume_create_manager' (7d296ddd-ed8c-4092-9b95-fb14838c2c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9142830e-3789-4ecd-99ab-f714ad0997d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9142830e-3789-4ecd-99ab-f714ad0997d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1491236751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b6592d-b625-46d7-b6d8-b0eec2072e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e701e4e47e340759e36791feef3aefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:24Z,use_quota=True,user_id='94f4c871283a4cb68886a7b6aac8e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7931bb0b-0605-450f-b5c0-3ed1014d3777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7931bb0b-0605-450f-b5c0-3ed1014d3777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27900e-5bda-44c4-a286-f7b86369284f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd27900e-5bda-44c4-a286-f7b86369284f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b6592d-b625-46d7-b6d8-b0eec2072e47', 'volume_name': 'volume-74b6592d-b625-46d7-b6d8-b0eec2072e47', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e7f141-d92e-4907-bdd9-47dc9a09003f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e7f141-d92e-4907-bdd9-47dc9a09003f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e77593-9989-4648-aa34-f9ed1feb158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Volume 74b6592d-b625-46d7-b6d8-b0eec2072e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b6592d-b625-46d7-b6d8-b0eec2072e47', 'volume_size': 1} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:24 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0" returned: 0 in 0.703s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:24 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0 Jul 30 16:37:24 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Flow 'volume_create_manager' (c949356c-c83d-46c7-bbb3-540a95ee999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f330d9b-9f38-4053-901e-aecc795a3522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f330d9b-9f38-4053-901e-aecc795a3522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1151305958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc06bfb5-788e-400c-bc00-d8e1cc67b7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a978261e13be4b5e972b1dbe8dfe5fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:25Z,use_quota=True,user_id='009b8f96076c4be0b01c2041b35620be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e70a11c-fb45-440d-938c-20e4a9df8afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e70a11c-fb45-440d-938c-20e4a9df8afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7722ad4b-6074-4a67-bc94-2ff0284ddcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7722ad4b-6074-4a67-bc94-2ff0284ddcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc06bfb5-788e-400c-bc00-d8e1cc67b7e2', 'volume_name': 'volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615209e1-6691-44d0-8ccd-fc9e70652bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615209e1-6691-44d0-8ccd-fc9e70652bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9c5752-80e8-42fe-989f-5005671f2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:25 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Volume cc06bfb5-788e-400c-bc00-d8e1cc67b7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2', 'volume_size': 1} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:25 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a 1073741824" returned: 0 in 0.848s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:25 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a Jul 30 16:37:25 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:25 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0" returned: 0 in 0.550s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Lock "cinder-quobyte-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0" released by "delete_volume" :: held 1.408s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Created reservations ['80c96793-89e8-4083-9659-3a139d44decc', 'cf05bb47-b58b-447c-bfcf-43ba0d6f66b3', '9416bf5e-3de0-423a-a406-6e667e424e63', '38306055-1fe3-4255-8baa-de3964b6dd07'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:25 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a" returned: 0 in 0.369s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1491236751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b6592d-b625-46d7-b6d8-b0eec2072e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e701e4e47e340759e36791feef3aefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:24Z,use_quota=True,user_id='94f4c871283a4cb68886a7b6aac8e671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Creating volume 74b6592d-b625-46d7-b6d8-b0eec2072e47 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:25 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c662a51-d943-4953-b38f-0c2bc16dd309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e940a6ec-ad8f-45e1-b3b5-8422825dff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:25 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 1073741824 Jul 30 16:37:25 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:25 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Volume volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a (3f40afd9-add8-4848-bd0e-f58e1f9f4e5a): created successfully Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e940a6ec-ad8f-45e1-b3b5-8422825dff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Flow 'volume_create_manager' (6767be62-2d6f-4f8f-bfad-f629d90e4631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9f4e0c8e-3929-4a0b-b121-a47535d4ff7a tempest-AbsoluteLimitsTests-114885992 None] Created volume successfully. Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:25 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:25 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:25 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.333s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Deleted volume successfully. Jul 30 16:37:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1b7c0763-f334-4887-b908-3ce6af499e03 tempest-VolumesServicesTestJSON-1067697100 None] Lock "cinder-ea0e9392-5cdd-4b29-a03a-d5b3ca2e55d0-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:26 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 1073741824" returned: 0 in 0.609s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:26 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 Jul 30 16:37:26 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:26 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47" returned: 0 in 0.334s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1151305958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc06bfb5-788e-400c-bc00-d8e1cc67b7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a978261e13be4b5e972b1dbe8dfe5fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:25Z,use_quota=True,user_id='009b8f96076c4be0b01c2041b35620be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Creating volume cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:26 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Acquiring lock "cinder-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:26 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 1073741824 Jul 30 16:37:26 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0e77593-9989-4648-aa34-f9ed1feb158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b6592d-b625-46d7-b6d8-b0eec2072e47', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802490e9-aa3a-4e9c-a514-5a617d796c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Lock "cinder-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:26 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Volume volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 (74b6592d-b625-46d7-b6d8-b0eec2072e47): created successfully Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802490e9-aa3a-4e9c-a514-5a617d796c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Flow 'volume_create_manager' (7d296ddd-ed8c-4092-9b95-fb14838c2c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-966dc44b-79b2-4922-9d4e-7fc5c8a959e3 tempest-ServerActionsTestOtherA-1074613001 None] Created volume successfully. Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Acquiring lock "cinder-quobyte-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Lock "cinder-quobyte-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a" acquired by "delete_volume" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[307f95ed-b80b-4793-8c74-218cfe854756]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:27 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a Jul 30 16:37:27 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:27 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 1073741824" returned: 0 in 0.658s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:27 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 Jul 30 16:37:27 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:27 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a" returned: 0 in 0.721s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:27 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a Jul 30 16:37:27 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:27 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2" returned: 0 in 0.516s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9c5752-80e8-42fe-989f-5005671f2054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fec446-ed95-45d6-aa71-4566dd97699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:27 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Volume volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 (cc06bfb5-788e-400c-bc00-d8e1cc67b7e2): created successfully Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fec446-ed95-45d6-aa71-4566dd97699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Flow 'volume_create_manager' (c949356c-c83d-46c7-bbb3-540a95ee999d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b8bc8f70-b877-43a6-9d65-59c1e90fb93e tempest-DeleteServersTestJSON-588963414 None] Created volume successfully. Jul 30 16:37:28 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a" returned: 0 in 0.484s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Lock "cinder-quobyte-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a" released by "delete_volume" :: held 1.289s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Created reservations ['4a09e964-2e65-4525-b41e-4bf9bb7bddc3', '46cba2a9-1545-4bc2-aaf5-b7b47031628b', '868a17fe-8c8a-462f-afcf-366254970335', '7b064c5f-ec27-4b1a-b9ea-2c881f897e85'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:28 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:28 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:28 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.370s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:28 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Deleted volume successfully. Jul 30 16:37:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5bf2411e-8d65-425c-b145-eaba47731120 tempest-AbsoluteLimitsTests-114885992 None] Lock "cinder-3f40afd9-add8-4848-bd0e-f58e1f9f4e5a-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-89a440f7-6933-404b-9d01-ab966de2c056 req-1f6965f4-3435-403e-889e-d786ef660827 tempest-DeleteServersTestJSON-588963414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-89a440f7-6933-404b-9d01-ab966de2c056 req-1f6965f4-3435-403e-889e-d786ef660827 tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-89a440f7-6933-404b-9d01-ab966de2c056 req-1f6965f4-3435-403e-889e-d786ef660827 tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-89a440f7-6933-404b-9d01-ab966de2c056 req-1f6965f4-3435-403e-889e-d786ef660827 tempest-DeleteServersTestJSON-588963414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c7734a9-ad46-4965-b56d-3b497754f43d', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:37:30 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-89a440f7-6933-404b-9d01-ab966de2c056 req-1f6965f4-3435-403e-889e-d786ef660827 tempest-DeleteServersTestJSON-588963414 None] attachment_update completed successfully. Jul 30 16:37:37 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-7cca28e0-e4dc-4b13-a2b1-e22a60ed44b3 req-73a371d4-0081-4a75-8caa-1e10ee85f870 tempest-DeleteServersTestJSON-588963414 None] Terminate volume connection completed successfully. Jul 30 16:37:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-7cca28e0-e4dc-4b13-a2b1-e22a60ed44b3 req-73a371d4-0081-4a75-8caa-1e10ee85f870 tempest-DeleteServersTestJSON-588963414 None] Deleting attachment 1c7734a9-ad46-4965-b56d-3b497754f43d. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:37:37 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Flow 'volume_create_manager' (5760e418-a676-47b2-b667-daaa904bd70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca22abc-4282-4afa-8499-861919c9ad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca22abc-4282-4afa-8499-861919c9ad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-723026628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7a734a-b25e-47b4-b3ba-4865e80e2dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a9daab8a5546c2a87fb7c866043234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:38Z,use_quota=True,user_id='f540c24807a741d2baafe42b7c2df04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c327a9-046e-4cfa-ba82-b925f81dea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c327a9-046e-4cfa-ba82-b925f81dea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4010d9b0-1116-45f0-96b0-1fe8535e7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4010d9b0-1116-45f0-96b0-1fe8535e7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7a734a-b25e-47b4-b3ba-4865e80e2dbd', 'volume_name': 'volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bed6f8-0597-4403-a7c5-e34c20260d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bed6f8-0597-4403-a7c5-e34c20260d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae50b2db-3757-4fea-afc0-544e4dbb30dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Volume ff7a734a-b25e-47b4-b3ba-4865e80e2dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd', 'volume_size': 1} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-723026628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7a734a-b25e-47b4-b3ba-4865e80e2dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34a9daab8a5546c2a87fb7c866043234',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:38Z,use_quota=True,user_id='f540c24807a741d2baafe42b7c2df04a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Creating volume ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:38 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:38 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd 1073741824 Jul 30 16:37:38 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Flow 'volume_create_manager' (3b06a60d-a6e3-4c34-ad5a-220e2f4b7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28245d9-3392-4924-b083-61b6aa61d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28245d9-3392-4924-b083-61b6aa61d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-737526987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdb1a257c144e4cb1427f489334f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:39Z,use_quota=True,user_id='7328f01e8e2343eca349d38629920516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21c925d-5ada-404f-8f38-11a32bc96339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21c925d-5ada-404f-8f38-11a32bc96339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9acb787-74cf-48ad-837c-977d9cdd254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9acb787-74cf-48ad-837c-977d9cdd254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8', 'volume_name': 'volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad17beb8-33c4-44a3-8606-c9a453270bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad17beb8-33c4-44a3-8606-c9a453270bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b8c209-da5e-4ca3-8060-9866a90c860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Volume eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8', 'volume_size': 1} Jul 30 16:37:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:39 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd 1073741824" returned: 0 in 0.847s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:39 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd Jul 30 16:37:39 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:39 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" returned: 0 in 0.262s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-737526987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdb1a257c144e4cb1427f489334f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:39Z,use_quota=True,user_id='7328f01e8e2343eca349d38629920516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Creating volume eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:39 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae50b2db-3757-4fea-afc0-544e4dbb30dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b499932-8998-49c6-86a5-7d6d1b326664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:39 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 1073741824 Jul 30 16:37:39 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Volume volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd (ff7a734a-b25e-47b4-b3ba-4865e80e2dbd): created successfully Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b499932-8998-49c6-86a5-7d6d1b326664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Flow 'volume_create_manager' (5760e418-a676-47b2-b667-daaa904bd70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-837abd4d-6a65-4a60-be33-a8f3e3744366 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Created volume successfully. Jul 30 16:37:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Acquiring lock "cinder-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Lock "cinder-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Acquiring lock "cinder-quobyte-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:40 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Lock "cinder-quobyte-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 1073741824" returned: 0 in 0.795s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d6c963-583d-4444-b413-31980125b190]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:40 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:40 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:40 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 Jul 30 16:37:40 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:40 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.216s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Creating offline snapshot 9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 of volume ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b8c209-da5e-4ca3-8060-9866a90c860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd383580-93dd-40db-9963-d5eed9852a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Volume volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 (eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8): created successfully Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd383580-93dd-40db-9963-d5eed9852a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Flow 'volume_create_manager' (3b06a60d-a6e3-4c34-ad5a-220e2f4b7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[14079abc-a2b1-44b2-8725-8a0d92410ae5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:40 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f03f3a99-8db4-46cb-ac6a-7b0b3cc1b8d9 tempest-VolumesDeleteCascade-1968052983 None] Created volume successfully. Jul 30 16:37:40 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2" returned: 0 in 0.767s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:40 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2 Jul 30 16:37:40 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:40 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd Jul 30 16:37:40 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:41 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2" returned: 0 in 0.447s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:41 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Lock "cinder-quobyte-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2" released by "delete_volume" :: held 1.306s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" returned: 0 in 0.639s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:41 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 1G Jul 30 16:37:41 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Created reservations ['43db044b-9831-4fce-8c45-f6ad21da2cd2', '621532ed-001e-41a8-907e-630f7f3d3fdd', '0eb20034-de21-4bfe-9074-786aaeea65fe', '22a0e630-e0fd-4362-8ed5-912a1bdc954f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:41 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:41 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:41 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.318s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:41 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Deleted volume successfully. Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-932eed81-fdea-4d27-b1a9-98f96d45110c tempest-DeleteServersTestJSON-588963414 None] Lock "cinder-cc06bfb5-788e-400c-bc00-d8e1cc67b7e2-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:42 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 1G" returned: 0 in 0.626s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:42 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 Jul 30 16:37:42 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:42 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:42 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 is being set with open permissions: ugo+rw Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:42 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 Jul 30 16:37:42 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:42 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" returned: 0 in 0.288s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:42 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info Jul 30 16:37:42 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:43 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info" returned: 0 in 0.365s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:43 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info is being set with open permissions: ugo+rw Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:43 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info Jul 30 16:37:43 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:43 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.info" returned: 0 in 0.338s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.763s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.986s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Creating offline snapshot b69ba54e-a4a1-4744-995d-d609c19b750a of volume eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:37:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-73520a8b-6401-4d1f-9775-6fe2e64718f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Create snapshot completed successfully Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068446e-7935-45a3-bc4e-d41566eb8dee]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:43 devstack sudo[92150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:43 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:44 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.463s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:44 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a 1G Jul 30 16:37:44 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:44 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a 1G" returned: 0 in 0.578s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:44 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:44 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:44 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.386s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:44 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a is being set with open permissions: ugo+rw Jul 30 16:37:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:45 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:45 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "cinder-9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "cinder-quobyte-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-quobyte-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "cinder-quobyte-9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:45 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-quobyte-9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Deleting offline snapshot 9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 of volume ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] snapshot_file for this snap is: volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2085319c-7a9c-40cc-9633-d0785097adcc]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:45 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info Jul 30 16:37:45 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:45 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 Jul 30 16:37:45 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:45 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info" returned: 0 in 0.407s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:45 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info is being set with open permissions: ugo+rw Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:45 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info Jul 30 16:37:45 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:45 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" returned: 0 in 0.516s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b697cc05-c43f-4fdd-9605-c3943514969e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:46 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd Jul 30 16:37:46 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:46 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.info" returned: 0 in 0.393s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.743s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7c95526c-0ef8-4790-8a25-6c30fb75e52b tempest-VolumesDeleteCascade-1968052983 None] Create snapshot completed successfully Jul 30 16:37:46 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" returned: 0 in 0.551s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:46 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 Jul 30 16:37:46 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:46 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:46 devstack sudo[92195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799 Jul 30 16:37:46 devstack sudo[92195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Creating offline snapshot cd2ebe78-d341-4822-8247-2c1489e8a3a8 of volume eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21f040f-bc53-42d0-b19d-15025a0c2745]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:47 devstack sudo[92195]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd.9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" returned: 0 in 0.410s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:47 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:47 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-quobyte-9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799" released by "_delete_snapshot" :: held 2.108s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-quobyte-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" released by "delete_snapshot" :: held 2.155s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Created reservations ['a38402e6-d77f-4c87-a317-9295d0873219', '0d26581b-8266-4d61-afec-282c2ed65672', 'd8730e9f-c0de-45d0-9cc1-422ccbd61844', '74653c56-b5bf-4c35-81e7-22beefe093ca'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Delete snapshot completed successfully. Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5cb43c6b-9d91-4bea-9345-df790fc7deb9 tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-9e7b2a3e-23b5-4d27-9aa5-f22f9cdb7799-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:47 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.496s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:47 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 1G Jul 30 16:37:47 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:48 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 1G" returned: 0 in 0.542s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:48 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 Jul 30 16:37:48 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "cinder-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "cinder-quobyte-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-quobyte-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:48 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8" returned: 0 in 0.491s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:48 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 is being set with open permissions: ugo+rw Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a7a803-8dd4-4fca-bf7b-45049cdfc473]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:48 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 Jul 30 16:37:48 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:48 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd Jul 30 16:37:48 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:49 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8" returned: 0 in 0.296s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d4a64b9c-961b-4276-9e79-5bf077590f81 tempest-VolumesDeleteCascade-1968052983 None] Create snapshot completed successfully Jul 30 16:37:49 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:49 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd Jul 30 16:37:49 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:49 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" returned: 0 in 0.281s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-quobyte-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd" released by "delete_volume" :: held 0.801s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Created reservations ['09908445-604d-43d5-aba1-20e82bb7aead', 'cc29b77c-f0f1-4c8a-acb7-5015598c1d8f', '765e4aa3-333e-4a56-aca2-22303626b18f', 'c94e9707-a795-4c76-81ce-b6504d18f305'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:49 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:49 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:50 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.369s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Deleted volume successfully. Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8f03c06b-3114-4d83-b7f8-543258db5bda tempest-VolumeSnapshotQuotasNegativeTestJSON-38892265 None] Lock "cinder-ff7a734a-b25e-47b4-b3ba-4865e80e2dbd-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Performing cascade delete. {{(pid=88380) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-b69ba54e-a4a1-4744-995d-d609c19b750a-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-b69ba54e-a4a1-4744-995d-d609c19b750a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-b69ba54e-a4a1-4744-995d-d609c19b750a" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-b69ba54e-a4a1-4744-995d-d609c19b750a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Deleting offline snapshot b69ba54e-a4a1-4744-995d-d609c19b750a of volume eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] snapshot_file for this snap is: volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a12768-118c-4c90-8348-d4f51fa78ef1]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:50 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:50 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:51 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.599s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb5b0a-3dd4-453b-83d1-02c9d8217ee7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:51 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:51 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:51 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.560s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a82215b-86e2-4761-ba77-c1518dd0237d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:51 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 Jul 30 16:37:51 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:52 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8" returned: 0 in 0.551s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d9b5a-6caa-48d2-813c-c5eb7c5a9af7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:52 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:52 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:52 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.481s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25056f-6454-4925-9916-c4a5bbbac50a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:53 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:53 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:53 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.572s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:53 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:53 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:53 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.490s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:53 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a Jul 30 16:37:53 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:54 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.b69ba54e-a4a1-4744-995d-d609c19b750a" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 -F qcow2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:54 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 -F qcow2 Jul 30 16:37:54 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:54 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 -F qcow2" returned: 0 in 0.360s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-b69ba54e-a4a1-4744-995d-d609c19b750a" released by "_delete_snapshot" :: held 4.147s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" released by "delete_snapshot" :: held 4.174s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:54 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:54 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Created reservations ['6045bd78-60ad-4c91-b34c-492df0c7dd90', '70334437-5e8f-4e27-ac21-d8fd9ca513b1', 'e24a8baf-510d-4779-a608-5cc2a297e979', 'd33dd74c-9d53-4166-932b-8322ca938480'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Delete snapshot completed successfully. Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-b69ba54e-a4a1-4744-995d-d609c19b750a-delete_snapshot" released by "delete_snapshot" :: held 4.389s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-cd2ebe78-d341-4822-8247-2c1489e8a3a8-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-cd2ebe78-d341-4822-8247-2c1489e8a3a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-cd2ebe78-d341-4822-8247-2c1489e8a3a8" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-cd2ebe78-d341-4822-8247-2c1489e8a3a8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Deleting offline snapshot cd2ebe78-d341-4822-8247-2c1489e8a3a8 of volume eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] snapshot_file for this snap is: volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6c507-01d7-4847-b9df-7df6f143fb5d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:54 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.330s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 8 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:37:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:37:55 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 Jul 30 16:37:55 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:55 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8" returned: 0 in 0.410s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:37:55 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e91f965-a159-451e-8816-bd191ae1cb21]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:55 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:55 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:55 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.397s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:55 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 Jul 30 16:37:55 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:56 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8" returned: 0 in 0.380s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:56 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8 Jul 30 16:37:56 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:56 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8.cd2ebe78-d341-4822-8247-2c1489e8a3a8" returned: 0 in 0.320s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-cd2ebe78-d341-4822-8247-2c1489e8a3a8" released by "_delete_snapshot" :: held 1.646s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" released by "delete_snapshot" :: held 1.674s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Created reservations ['0916627d-c773-417f-952c-759847b89cfa', '1e933711-635e-44e1-a218-a4fac06d150f', 'e22d1796-5011-46d8-a45f-ec66e086e5c1', '26c9ff24-d394-4e8d-9b1c-75e6d42e4d35'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Delete snapshot completed successfully. Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-cd2ebe78-d341-4822-8247-2c1489e8a3a8-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Snapshots deleted, issuing volume delete {{(pid=88380) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" acquired by "delete_volume" :: waited 0.013s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2af46-ebd0-4f60-99bc-0acda177206b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:37:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:56 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:56 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:57 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.441s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:57 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8 Jul 30 16:37:57 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:57 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8" released by "delete_volume" :: held 0.811s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Created reservations ['dbf243ff-0e81-4528-8cc2-ed47a0e761a0', '0f4be133-f585-4207-b475-b23de5f2f86e', '7a785f50-fd37-47c8-8f7f-fbd311e283f8', '3c515651-bee9-4bd6-93e4-c536f4e9cf25'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:57 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:37:57 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:57 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.319s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:37:58 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Deleted volume successfully. Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-39366479-5a5b-4874-b960-ba9b36a5e336 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-eaaa720c-2dc8-4e0a-9e20-b67d3dce0af8-delete_volume" released by "delete_volume" :: held 7.767s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=126,cinder:SELECT=100,cinder:INSERT=33,cinder:DELETE=10 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=103,cinder:UPDATE=116,cinder:DELETE=11,cinder:INSERT=27 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Flow 'volume_create_manager' (1782b662-d0ce-4fa9-b074-8779c12d848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40596e2-e3f4-4fbf-a892-18dd8d87932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40596e2-e3f4-4fbf-a892-18dd8d87932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1412588539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fd9af8-b415-4c68-92b2-81adac8119c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdb1a257c144e4cb1427f489334f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:59Z,use_quota=True,user_id='7328f01e8e2343eca349d38629920516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab79e5c-731c-45e5-9e54-b7ea05d7dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab79e5c-731c-45e5-9e54-b7ea05d7dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12178e09-d199-4818-8bf0-44083eed987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12178e09-d199-4818-8bf0-44083eed987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fd9af8-b415-4c68-92b2-81adac8119c8', 'volume_name': 'volume-a0fd9af8-b415-4c68-92b2-81adac8119c8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ec93d3-d14e-49f6-b339-cfa81771efa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ec93d3-d14e-49f6-b339-cfa81771efa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e26d58-868f-43c7-a42e-14a705e573d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:58 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Volume a0fd9af8-b415-4c68-92b2-81adac8119c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fd9af8-b415-4c68-92b2-81adac8119c8', 'volume_size': 1} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1412588539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fd9af8-b415-4c68-92b2-81adac8119c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdb1a257c144e4cb1427f489334f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:37:59Z,use_quota=True,user_id='7328f01e8e2343eca349d38629920516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Creating volume a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:37:58 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:37:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:59 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 1073741824 Jul 30 16:37:59 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:59 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 1073741824" returned: 0 in 0.602s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:37:59 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 Jul 30 16:37:59 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:37:59 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e26d58-868f-43c7-a42e-14a705e573d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fd9af8-b415-4c68-92b2-81adac8119c8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac4b6c4-5c4b-4108-bc34-f178ef48551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:37:59 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Volume volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 (a0fd9af8-b415-4c68-92b2-81adac8119c8): created successfully Jul 30 16:37:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cac4b6c4-5c4b-4108-bc34-f178ef48551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Flow 'volume_create_manager' (1782b662-d0ce-4fa9-b074-8779c12d848e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-cd32154d-d655-48a5-af53-276e50f34c32 tempest-VolumesDeleteCascade-1968052983 None] Created volume successfully. Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Creating offline snapshot 872f7009-c869-46f5-84d9-1395b1e31d6f of volume a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bea33b-12f1-4c1f-82d6-552fca2f6d47]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:01 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 Jul 30 16:38:01 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:01 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8" returned: 0 in 0.415s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:01 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f 1G Jul 30 16:38:01 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:02 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f 1G" returned: 0 in 0.524s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:02 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f Jul 30 16:38:02 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:02 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:02 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f is being set with open permissions: ugo+rw Jul 30 16:38:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:02 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f Jul 30 16:38:02 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:03 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f" returned: 0 in 0.349s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:03 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info Jul 30 16:38:03 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:03 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info" returned: 0 in 0.365s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:03 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info is being set with open permissions: ugo+rw Jul 30 16:38:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:03 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info Jul 30 16:38:03 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:03 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.info" returned: 0 in 0.460s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d27e7cd-5f1a-4e77-95f8-4dd2a14c80d9 tempest-VolumesDeleteCascade-1968052983 None] Create snapshot completed successfully Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Flow 'volume_create_manager' (bfb8305a-dc0b-4bdd-a4c7-6cf6da1744d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559153ce-deb8-4aed-ac8d-f2cf192cd5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559153ce-deb8-4aed-ac8d-f2cf192cd5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1430972047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f82502-ae0c-4eb6-acd8-95a4eb69adcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdb1a257c144e4cb1427f489334f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=872f7009-c869-46f5-84d9-1395b1e31d6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:05Z,use_quota=True,user_id='7328f01e8e2343eca349d38629920516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fba4929-ea80-47c8-beb2-0f1e1cbd15e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fba4929-ea80-47c8-beb2-0f1e1cbd15e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc6be7-d162-4ee5-a0d0-755fb0536330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc6be7-d162-4ee5-a0d0-755fb0536330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23f82502-ae0c-4eb6-acd8-95a4eb69adcf', 'volume_name': 'volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf', 'volume_size': 1, 'snapshot_id': '872f7009-c869-46f5-84d9-1395b1e31d6f'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b900a111-9aec-4cc9-a198-ff63be661fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b900a111-9aec-4cc9-a198-ff63be661fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafdbe5a-e6b9-4531-8a96-1a8543d90531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:05 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Volume 23f82502-ae0c-4eb6-acd8-95a4eb69adcf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf', 'volume_size': 1, 'snapshot_id': '872f7009-c869-46f5-84d9-1395b1e31d6f'} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-872f7009-c869-46f5-84d9-1395b1e31d6f-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-872f7009-c869-46f5-84d9-1395b1e31d6f-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Creating volume 23f82502-ae0c-4eb6-acd8-95a4eb69adcf from snapshot 872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] snapshot: 872f7009-c869-46f5-84d9-1395b1e31d6f, volume: 23f82502-ae0c-4eb6-acd8-95a4eb69adcf, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bdce5b-21c5-4bf6-a548-36a4b9ad2c3c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:05 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f Jul 30 16:38:05 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:06 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f" returned: 0 in 0.692s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0fd9af8-b415-4c68-92b2-81adac8119c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[33efbef1-d865-4024-9846-f632e329a3bc]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:06 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 Jul 30 16:38:06 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:06 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8" returned: 0 in 0.586s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:38:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:06 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf Jul 30 16:38:06 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-dd0a8312-30b7-4497-9961-d78fb4f7d8b6 req-20c43a61-9007-4e18-a29d-f260dca5f6dc tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:13 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" returned: 0 in 6.748s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:13 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:38:13 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Converted 1024.00 MB image at 151.66 MB/s Jul 30 16:38:13 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf is being set with open permissions: ugo+rw Jul 30 16:38:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:13 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf Jul 30 16:38:13 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:14 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" returned: 0 in 0.347s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" released by "_copy_volume_from_snapshot" :: held 8.506s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-872f7009-c869-46f5-84d9-1395b1e31d6f-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" released by "_create_volume_from_snapshot" :: held 8.625s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.658s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-dd0a8312-30b7-4497-9961-d78fb4f7d8b6 req-20c43a61-9007-4e18-a29d-f260dca5f6dc tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.060s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-dd0a8312-30b7-4497-9961-d78fb4f7d8b6 req-20c43a61-9007-4e18-a29d-f260dca5f6dc tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafdbe5a-e6b9-4531-8a96-1a8543d90531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf', 'volume_size': 1, 'snapshot_id': '872f7009-c869-46f5-84d9-1395b1e31d6f'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea9a3b3-15a2-4d43-8ed3-868c726090ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Volume volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf (23f82502-ae0c-4eb6-acd8-95a4eb69adcf): created successfully Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea9a3b3-15a2-4d43-8ed3-868c726090ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Flow 'volume_create_manager' (bfb8305a-dc0b-4bdd-a4c7-6cf6da1744d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-dd0a8312-30b7-4497-9961-d78fb4f7d8b6 req-20c43a61-9007-4e18-a29d-f260dca5f6dc tempest-ServerActionsTestOtherA-1074613001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-74b6592d-b625-46d7-b6d8-b0eec2072e47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9b48798-ebd5-4f2e-b4c9-cfdcf37ef905', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:38:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4b5d74f2-1d5e-492d-9d71-c6081e56e713 tempest-VolumesDeleteCascade-1968052983 None] Created volume successfully. Jul 30 16:38:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-dd0a8312-30b7-4497-9961-d78fb4f7d8b6 req-20c43a61-9007-4e18-a29d-f260dca5f6dc tempest-ServerActionsTestOtherA-1074613001 None] attachment_update completed successfully. Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-a0fd9af8-b415-4c68-92b2-81adac8119c8-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-a0fd9af8-b415-4c68-92b2-81adac8119c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Performing cascade delete. {{(pid=88380) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-872f7009-c869-46f5-84d9-1395b1e31d6f-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-872f7009-c869-46f5-84d9-1395b1e31d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-a0fd9af8-b415-4c68-92b2-81adac8119c8" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-a0fd9af8-b415-4c68-92b2-81adac8119c8" acquired by "delete_snapshot" :: waited 0.075s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-872f7009-c869-46f5-84d9-1395b1e31d6f" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Flow 'volume_create_manager' (33b98986-e516-451e-ab8c-d6ea616950ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f0a7da-a3b0-47fb-8f39-15987f499dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-872f7009-c869-46f5-84d9-1395b1e31d6f" acquired by "_delete_snapshot" :: waited 0.124s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Deleting offline snapshot 872f7009-c869-46f5-84d9-1395b1e31d6f of volume a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] snapshot_file for this snap is: volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c037e-02e4-45c8-92a6-bc90bfe28162]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1f0a7da-a3b0-47fb-8f39-15987f499dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1905274907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8077d7b-aecb-44de-a58b-327f8594ae82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcfa9da4d634200a43face16859e549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:15Z,use_quota=True,user_id='0c79a7c6d8494845816331d1338c31ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02fce2b-e816-4f96-abdc-a2a15c2ee6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02fce2b-e816-4f96-abdc-a2a15c2ee6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093e796-50a3-487e-9df0-e7288caafc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093e796-50a3-487e-9df0-e7288caafc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8077d7b-aecb-44de-a58b-327f8594ae82', 'volume_name': 'volume-f8077d7b-aecb-44de-a58b-327f8594ae82', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c956f527-ff48-44b0-bf3f-64bdcff00dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c956f527-ff48-44b0-bf3f-64bdcff00dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9480dee2-0d6b-484f-85e3-c674b30b2ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:15 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Volume f8077d7b-aecb-44de-a58b-327f8594ae82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8077d7b-aecb-44de-a58b-327f8594ae82', 'volume_size': 1} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1905274907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8077d7b-aecb-44de-a58b-327f8594ae82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebcfa9da4d634200a43face16859e549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:15Z,use_quota=True,user_id='0c79a7c6d8494845816331d1338c31ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Creating volume f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:15 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:38:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:15 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 1073741824 Jul 30 16:38:15 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:15 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f Jul 30 16:38:15 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:16 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f" returned: 0 in 0.841s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0fd9af8-b415-4c68-92b2-81adac8119c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:38:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6415bc-72af-4c9d-b96b-a1e09a9deaa9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:16 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 1073741824" returned: 0 in 0.894s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:16 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 Jul 30 16:38:16 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:16 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:38:16 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.446s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:17 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9480dee2-0d6b-484f-85e3-c674b30b2ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8077d7b-aecb-44de-a58b-327f8594ae82', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0227d9de-179e-4f61-9347-872a818035b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:17 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Volume volume-f8077d7b-aecb-44de-a58b-327f8594ae82 (f8077d7b-aecb-44de-a58b-327f8594ae82): created successfully Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0227d9de-179e-4f61-9347-872a818035b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Flow 'volume_create_manager' (33b98986-e516-451e-ab8c-d6ea616950ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:17 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-29594fdd-4194-4421-9e5f-8ff6a2acb4ff tempest-VolumesActionsTest-1032088384 None] Created volume successfully. Jul 30 16:38:17 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8" returned: 0 in 0.794s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:17 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f Jul 30 16:38:17 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:17 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f" returned: 0 in 0.502s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:17 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f Jul 30 16:38:17 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:18 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8.872f7009-c869-46f5-84d9-1395b1e31d6f" returned: 0 in 0.515s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-872f7009-c869-46f5-84d9-1395b1e31d6f" released by "_delete_snapshot" :: held 2.952s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-a0fd9af8-b415-4c68-92b2-81adac8119c8" released by "delete_snapshot" :: held 3.205s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Created reservations ['7066a4ca-3b70-424f-b9b9-5ff73c7e0c14', 'f5fe8a65-17e3-4e32-8fec-cfcb904e3f02', '46828b91-eb36-40d9-a4c6-db50911f6ebb', 'ce4981c5-2244-4445-a8c3-49bc6a877eb5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:19 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Delete snapshot completed successfully. Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-872f7009-c869-46f5-84d9-1395b1e31d6f-delete_snapshot" released by "delete_snapshot" :: held 3.849s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Snapshots deleted, issuing volume delete {{(pid=88380) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-a0fd9af8-b415-4c68-92b2-81adac8119c8" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-a0fd9af8-b415-4c68-92b2-81adac8119c8" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d85697f-27aa-4686-ad9d-2552f86599da]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:19 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 Jul 30 16:38:19 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:20 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8" returned: 0 in 1.117s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:20 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8 Jul 30 16:38:20 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:21 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a0fd9af8-b415-4c68-92b2-81adac8119c8" returned: 0 in 0.612s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-a0fd9af8-b415-4c68-92b2-81adac8119c8" released by "delete_volume" :: held 1.901s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Created reservations ['5c812747-c9e2-4f9e-b6f6-4592a8a868a0', '991142df-1ea6-47f3-bb65-47f2c5f582bb', '0a63f7d0-3b94-44ed-a422-274eb502c4b6', '28be032a-02b8-4faf-bffa-ef1d753568cc'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:21 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:38:21 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-5047362f-91fe-4e23-82a9-4e9c8af9c6a9 tempest-ServerActionsTestOtherA-1074613001 None] Terminate volume connection completed successfully. Jul 30 16:38:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-5047362f-91fe-4e23-82a9-4e9c8af9c6a9 tempest-ServerActionsTestOtherA-1074613001 None] Deleting attachment e9b48798-ebd5-4f2e-b4c9-cfdcf37ef905. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:38:22 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.476s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:22 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Deleted volume successfully. Jul 30 16:38:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1eb1c2-17e1-4471-88f1-322513aaf16b tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-a0fd9af8-b415-4c68-92b2-81adac8119c8-delete_volume" released by "delete_volume" :: held 6.881s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-23f82502-ae0c-4eb6-acd8-95a4eb69adcf-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-23f82502-ae0c-4eb6-acd8-95a4eb69adcf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "cinder-quobyte-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" acquired by "delete_volume" :: waited 0.081s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c849cd-30aa-464e-b095-bae70045e88b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-eb736273-5af6-45a6-800d-97bb49eec3cd tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-eb736273-5af6-45a6-800d-97bb49eec3cd tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-eb736273-5af6-45a6-800d-97bb49eec3cd tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:23 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf Jul 30 16:38:23 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-eb736273-5af6-45a6-800d-97bb49eec3cd tempest-ServerActionsTestOtherA-1074613001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-74b6592d-b625-46d7-b6d8-b0eec2072e47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '394c3bf6-8bdc-4a74-80a1-59f3d52ab3aa', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:38:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-168bb527-1ea4-4cfb-a7e8-503f9f69ea0d req-eb736273-5af6-45a6-800d-97bb49eec3cd tempest-ServerActionsTestOtherA-1074613001 None] attachment_update completed successfully. Jul 30 16:38:24 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" returned: 0 in 1.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:24 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf Jul 30 16:38:24 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:25 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" returned: 0 in 0.526s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-quobyte-23f82502-ae0c-4eb6-acd8-95a4eb69adcf" released by "delete_volume" :: held 1.965s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Created reservations ['5948ec87-2d66-4b97-bf89-ecac6ee9f80d', '5cc97a77-db2e-4a0e-a97b-ef651414d3b2', 'eb54492d-69c1-4d76-84d0-eaa56869fea0', 'a90e4d49-0ac0-4fea-8a6d-3fac9b758a54'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:25 devstack sudo[93179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:38:25 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:26 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.594s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:26 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Deleted volume successfully. Jul 30 16:38:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d9e8049c-e1df-4745-9899-ff77694acf85 tempest-VolumesDeleteCascade-1968052983 None] Lock "cinder-23f82502-ae0c-4eb6-acd8-95a4eb69adcf-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:35 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=40,cinder:INSERT=7,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:38:36 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=40,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=9 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Flow 'volume_create_manager' (42218751-d883-4099-a307-d2324f240cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c87919-b230-455b-bdb1-32456d1e664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c87919-b230-455b-bdb1-32456d1e664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-782784776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324857ef-2f88-436c-b76a-d281727f870a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa648ae4d5f46ceacf459b888fb0a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:38Z,use_quota=True,user_id='405f9600aaca4d199735c0bc9d996105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068f518c-f5d1-4e82-84d1-23df8b0400f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068f518c-f5d1-4e82-84d1-23df8b0400f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010accf-f54c-413a-8a00-6ca4ac7df81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2010accf-f54c-413a-8a00-6ca4ac7df81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324857ef-2f88-436c-b76a-d281727f870a', 'volume_name': 'volume-324857ef-2f88-436c-b76a-d281727f870a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd14ace-e77c-4a46-ba19-c788cd9851ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd14ace-e77c-4a46-ba19-c788cd9851ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32fbca0-ccde-4f02-b624-2f18c29a84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Volume 324857ef-2f88-436c-b76a-d281727f870a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324857ef-2f88-436c-b76a-d281727f870a', 'volume_size': 1} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-782784776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=324857ef-2f88-436c-b76a-d281727f870a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa648ae4d5f46ceacf459b888fb0a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:38Z,use_quota=True,user_id='405f9600aaca4d199735c0bc9d996105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Creating volume 324857ef-2f88-436c-b76a-d281727f870a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:38 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:38:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:38 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a 1073741824 Jul 30 16:38:38 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:39 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a 1073741824" returned: 0 in 1.109s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:39 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a Jul 30 16:38:39 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:39 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32fbca0-ccde-4f02-b624-2f18c29a84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324857ef-2f88-436c-b76a-d281727f870a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5e19d8-a15a-436c-8d48-61570e032173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Volume volume-324857ef-2f88-436c-b76a-d281727f870a (324857ef-2f88-436c-b76a-d281727f870a): created successfully Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5e19d8-a15a-436c-8d48-61570e032173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Flow 'volume_create_manager' (42218751-d883-4099-a307-d2324f240cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-12015dc2-17f0-4e64-8118-21dbcd6ba71f tempest-VolumesTransfersTest-596566567 None] Created volume successfully. Jul 30 16:38:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ba1fec45-5cfd-421c-9271-9c53c0fe4780 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82" by "attach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ba1fec45-5cfd-421c-9271-9c53c0fe4780 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82" acquired by "attach_volume" :: waited 0.041s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ba1fec45-5cfd-421c-9271-9c53c0fe4780 tempest-VolumesActionsTest-1032088384 None] Attaching volume f8077d7b-aecb-44de-a58b-327f8594ae82 to instance 6dce801b-c291-4da8-8877-1cc8893a1d57 at mountpoint /dev/vdb on host None. Jul 30 16:38:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ba1fec45-5cfd-421c-9271-9c53c0fe4780 tempest-VolumesActionsTest-1032088384 None] Attach volume completed successfully. Jul 30 16:38:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ba1fec45-5cfd-421c-9271-9c53c0fe4780 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82" released by "attach_volume" :: held 0.126s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-60e60827-308f-49d4-8376-07a8e76640db tempest-VolumesTransfersTest-349825685 None] Transfer volume completed successfully. Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-31ca93bd-f4ff-423d-a9d1-13c9149d92a7 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-detach_volume" by "detach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-31ca93bd-f4ff-423d-a9d1-13c9149d92a7 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-31ca93bd-f4ff-423d-a9d1-13c9149d92a7 tempest-VolumesActionsTest-1032088384 None] Detaching volume f8077d7b-aecb-44de-a58b-327f8594ae82 from instance 6dce801b-c291-4da8-8877-1cc8893a1d57. Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Flow 'volume_create_manager' (58e4ad4c-91e1-4537-83f8-8ee437f6ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb74e390-4d6f-43e9-b66c-fb60994f6ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb74e390-4d6f-43e9-b66c-fb60994f6ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1026505317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e82b841e824679a7c86fa66c84ed57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:43Z,use_quota=True,user_id='1994d85165d441b781d5917ac82905d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb19ded-1958-4f5d-a5b9-1dd1d53d4dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb19ded-1958-4f5d-a5b9-1dd1d53d4dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b65448-83ae-4a3e-9849-cfc4d75ebb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b65448-83ae-4a3e-9849-cfc4d75ebb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f0e422-dc9c-4b10-a327-6c8e4d8aafe2', 'volume_name': 'volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69da2266-4e61-4b0c-8370-05acd74f5da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69da2266-4e61-4b0c-8370-05acd74f5da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c053b-86bd-48f7-a57a-a8036b061d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Volume d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2', 'volume_size': 1} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1026505317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e82b841e824679a7c86fa66c84ed57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:43Z,use_quota=True,user_id='1994d85165d441b781d5917ac82905d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Creating volume d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:42 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:42 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 1073741824 Jul 30 16:38:42 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-31ca93bd-f4ff-423d-a9d1-13c9149d92a7 tempest-VolumesActionsTest-1032088384 None] Detach volume completed successfully. Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-31ca93bd-f4ff-423d-a9d1-13c9149d92a7 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-detach_volume" released by "detach_volume" :: held 0.202s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Acquiring lock "cinder-324857ef-2f88-436c-b76a-d281727f870a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Lock "cinder-324857ef-2f88-436c-b76a-d281727f870a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Acquiring lock "cinder-quobyte-324857ef-2f88-436c-b76a-d281727f870a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Lock "cinder-quobyte-324857ef-2f88-436c-b76a-d281727f870a" acquired by "delete_volume" :: waited 0.042s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e2413a-1335-47c0-a244-aa1371b68f53]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:43 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a Jul 30 16:38:43 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:43 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 1073741824" returned: 0 in 1.000s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:43 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a" returned: 0 in 0.631s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:43 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 Jul 30 16:38:43 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:43 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a Jul 30 16:38:43 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:44 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2" returned: 0 in 0.330s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c053b-86bd-48f7-a57a-a8036b061d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95be0971-7120-4a80-97cd-883eec260cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Volume volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 (d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2): created successfully Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95be0971-7120-4a80-97cd-883eec260cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Flow 'volume_create_manager' (58e4ad4c-91e1-4537-83f8-8ee437f6ab30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5611d879-f9da-4f33-b859-a05796caa0ca tempest-ServerRescueNegativeTestJSON-239515939 None] Created volume successfully. Jul 30 16:38:44 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-324857ef-2f88-436c-b76a-d281727f870a" returned: 0 in 0.612s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Lock "cinder-quobyte-324857ef-2f88-436c-b76a-d281727f870a" released by "delete_volume" :: held 1.330s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Created reservations ['acf9a276-4440-464b-b5b5-717a54c00cd8', '94799224-f399-4c8f-8ba5-11899e8f9455', '91170ce9-c86f-470c-8877-d38ebfc86997', 'b60cb3e3-432e-480d-9a0f-f4c2008a0bb4'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:44 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:38:44 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:45 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.457s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:45 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Deleted volume successfully. Jul 30 16:38:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a99bd46f-46cf-4450-a125-473eb71cc39d tempest-VolumesTransfersTest-526434596 None] Lock "cinder-324857ef-2f88-436c-b76a-d281727f870a-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Flow 'volume_create_manager' (8da81b3e-afc0-4e96-8aa4-fa1280dcfdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20469318-4786-43fd-b505-1a2aa063fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20469318-4786-43fd-b505-1a2aa063fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2055706868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30edf9d6-829d-469b-9b29-16942a071160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa648ae4d5f46ceacf459b888fb0a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:47Z,use_quota=True,user_id='405f9600aaca4d199735c0bc9d996105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702307b8-639a-4095-b009-9c277cc8844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702307b8-639a-4095-b009-9c277cc8844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97efdd1-4e0f-4e11-b776-0ab82c1913ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b97efdd1-4e0f-4e11-b776-0ab82c1913ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30edf9d6-829d-469b-9b29-16942a071160', 'volume_name': 'volume-30edf9d6-829d-469b-9b29-16942a071160', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6da1a0-77a2-4fcd-ac7b-8a6781329ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6da1a0-77a2-4fcd-ac7b-8a6781329ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e1a8ff-c09d-4fdd-abd5-2470f322d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Volume 30edf9d6-829d-469b-9b29-16942a071160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30edf9d6-829d-469b-9b29-16942a071160', 'volume_size': 1} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2055706868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30edf9d6-829d-469b-9b29-16942a071160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa648ae4d5f46ceacf459b888fb0a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:38:47Z,use_quota=True,user_id='405f9600aaca4d199735c0bc9d996105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Creating volume 30edf9d6-829d-469b-9b29-16942a071160 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:38:46 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:38:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:47 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 1073741824 Jul 30 16:38:47 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:47 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 1073741824" returned: 0 in 0.879s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:48 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 Jul 30 16:38:48 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:48 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160" returned: 0 in 0.347s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e1a8ff-c09d-4fdd-abd5-2470f322d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30edf9d6-829d-469b-9b29-16942a071160', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2c88c1-3514-4064-ae64-0c5d8f2b6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:38:48 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Volume volume-30edf9d6-829d-469b-9b29-16942a071160 (30edf9d6-829d-469b-9b29-16942a071160): created successfully Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2c88c1-3514-4064-ae64-0c5d8f2b6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:38:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Flow 'volume_create_manager' (8da81b3e-afc0-4e96-8aa4-fa1280dcfdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:38:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a42e90e4-0457-4a6c-8305-753faf7d051c tempest-VolumesTransfersTest-596566567 None] Created volume successfully. Jul 30 16:38:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Acquiring lock "cinder-30edf9d6-829d-469b-9b29-16942a071160-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Lock "cinder-30edf9d6-829d-469b-9b29-16942a071160-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Acquiring lock "cinder-quobyte-30edf9d6-829d-469b-9b29-16942a071160" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Lock "cinder-quobyte-30edf9d6-829d-469b-9b29-16942a071160" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:49 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe1f385-8626-456f-90c5-8cc867207b8e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:49 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 Jul 30 16:38:49 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:50 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160" returned: 0 in 0.634s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:50 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160 Jul 30 16:38:50 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:50 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30edf9d6-829d-469b-9b29-16942a071160" returned: 0 in 0.469s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Lock "cinder-quobyte-30edf9d6-829d-469b-9b29-16942a071160" released by "delete_volume" :: held 1.167s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Created reservations ['6c770a16-a98c-4e21-ad73-a2c2853d1530', '6d9b108a-fba4-4e4c-9446-e9a6f57d1a10', '0343841d-9868-4415-9322-5b9aba287662', '15d9f2b4-9da8-471b-a83f-0b05636d1de1'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:50 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:38:50 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:51 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.397s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:51 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Deleted volume successfully. Jul 30 16:38:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5159dfa7-e5be-4948-ac73-c6642ff2f5f2 tempest-VolumesTransfersTest-526434596 None] Lock "cinder-30edf9d6-829d-469b-9b29-16942a071160-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:38:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:38:54 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:38:54 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:38:55 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 30 16:38:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.424s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:38:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:38:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:38:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 8 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:38:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:38:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Acquiring lock "cinder-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "cinder-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Acquiring lock "cinder-quobyte-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:38:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "cinder-quobyte-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:38:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[904b9950-5908-431f-a367-dec5c5785d9f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:38:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:00 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 Jul 30 16:39:00 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-5f1592fa-b34c-439b-9c84-5541056ca4bc req-1ff2719f-a8d8-4545-a20c-2b33592d9ee6 tempest-ServerActionsTestOtherA-1074613001 None] Terminate volume connection completed successfully. Jul 30 16:39:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-5f1592fa-b34c-439b-9c84-5541056ca4bc req-1ff2719f-a8d8-4545-a20c-2b33592d9ee6 tempest-ServerActionsTestOtherA-1074613001 None] Deleting attachment 394c3bf6-8bdc-4a74-80a1-59f3d52ab3aa. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:39:00 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2" returned: 0 in 1.032s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:00 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2 Jul 30 16:39:00 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:01 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2" returned: 0 in 0.456s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "cinder-quobyte-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2" released by "delete_volume" :: held 1.581s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Created reservations ['2ecf4610-0c27-48af-92a7-34266fe6e383', '24c2d496-4b4b-43aa-ac97-800aae0a65d4', 'b0eecac4-3e7d-4bf1-b102-5d515e5513ea', '35b0dd63-71a8-42a5-95b9-f4caef86dcf0'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:01 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:39:01 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:02 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.460s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:02 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Deleted volume successfully. Jul 30 16:39:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2b71f259-b3d7-41e6-8089-c84d9b020884 tempest-ServerRescueNegativeTestJSON-239515939 None] Lock "cinder-d8f0e422-dc9c-4b10-a327-6c8e4d8aafe2-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6ae6df5c-c06e-44ed-b461-05e88d89cc06 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82" by "attach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6ae6df5c-c06e-44ed-b461-05e88d89cc06 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82" acquired by "attach_volume" :: waited 0.098s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6ae6df5c-c06e-44ed-b461-05e88d89cc06 tempest-VolumesActionsTest-1032088384 None] Attaching volume f8077d7b-aecb-44de-a58b-327f8594ae82 to instance 0e749c4a-27ee-4665-9bac-bf7d2903b977 at mountpoint /dev/vdb on host None. Jul 30 16:39:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6ae6df5c-c06e-44ed-b461-05e88d89cc06 tempest-VolumesActionsTest-1032088384 None] Attach volume completed successfully. Jul 30 16:39:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6ae6df5c-c06e-44ed-b461-05e88d89cc06 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82" released by "attach_volume" :: held 0.303s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c3aec0f5-93ce-4943-94de-fdb4af5a234f tempest-VolumesActionsTest-1032088384 None] Acquiring lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-detach_volume" by "detach_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c3aec0f5-93ce-4943-94de-fdb4af5a234f tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-detach_volume" acquired by "detach_volume" :: waited 0.077s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c3aec0f5-93ce-4943-94de-fdb4af5a234f tempest-VolumesActionsTest-1032088384 None] Detaching volume f8077d7b-aecb-44de-a58b-327f8594ae82 from instance 0e749c4a-27ee-4665-9bac-bf7d2903b977. Jul 30 16:39:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c3aec0f5-93ce-4943-94de-fdb4af5a234f tempest-VolumesActionsTest-1032088384 None] Detach volume completed successfully. Jul 30 16:39:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c3aec0f5-93ce-4943-94de-fdb4af5a234f tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-detach_volume" released by "detach_volume" :: held 0.188s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Flow 'volume_create_manager' (51bec8aa-97d3-4d8e-a63b-3f70c3c56638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e416649-f910-46a3-aa04-df534966c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e416649-f910-46a3-aa04-df534966c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-761757739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3920c021-f028-4b9f-9e2f-b04a3125c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55436fce99c145e08b942248d1bf99c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:06Z,use_quota=True,user_id='d287a54f1375418bb4f550e1a84ab113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4730e-a7a1-439a-ab5a-08d969fd3c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4730e-a7a1-439a-ab5a-08d969fd3c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ffbb50-e3ce-43e4-ac11-7c5734fb7e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ffbb50-e3ce-43e4-ac11-7c5734fb7e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3920c021-f028-4b9f-9e2f-b04a3125c96e', 'volume_name': 'volume-3920c021-f028-4b9f-9e2f-b04a3125c96e', 'volume_size': 2}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0039b895-8521-4344-9de2-d9ddcc858391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0039b895-8521-4344-9de2-d9ddcc858391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27dc1df-e1f5-4483-8b1c-b93a19939c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:05 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Volume 3920c021-f028-4b9f-9e2f-b04a3125c96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3920c021-f028-4b9f-9e2f-b04a3125c96e', 'volume_size': 2} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-761757739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3920c021-f028-4b9f-9e2f-b04a3125c96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55436fce99c145e08b942248d1bf99c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:06Z,use_quota=True,user_id='d287a54f1375418bb4f550e1a84ab113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Creating volume 3920c021-f028-4b9f-9e2f-b04a3125c96e {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:05 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:39:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e 2147483648 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:05 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e 2147483648 Jul 30 16:39:05 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:06 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e 2147483648" returned: 0 in 1.195s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:07 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e Jul 30 16:39:07 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:07 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e" returned: 0 in 0.584s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c27dc1df-e1f5-4483-8b1c-b93a19939c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3920c021-f028-4b9f-9e2f-b04a3125c96e', 'volume_size': 2}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10765437-df3d-41b4-bb48-3fb8d6b02eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Volume volume-3920c021-f028-4b9f-9e2f-b04a3125c96e (3920c021-f028-4b9f-9e2f-b04a3125c96e): created successfully Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10765437-df3d-41b4-bb48-3fb8d6b02eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Flow 'volume_create_manager' (51bec8aa-97d3-4d8e-a63b-3f70c3c56638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-82c9acaf-37ae-4a95-9abe-d03bb52528ca tempest-VolumesCloneNegativeTest-1133574432 None] Created volume successfully. Jul 30 16:39:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Acquiring lock "cinder-3920c021-f028-4b9f-9e2f-b04a3125c96e-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Lock "cinder-3920c021-f028-4b9f-9e2f-b04a3125c96e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Acquiring lock "cinder-quobyte-3920c021-f028-4b9f-9e2f-b04a3125c96e" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Lock "cinder-quobyte-3920c021-f028-4b9f-9e2f-b04a3125c96e" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b794c1c5-eb74-4799-859a-b198d6a1faa8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:09 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e Jul 30 16:39:09 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:10 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e" returned: 0 in 0.613s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:10 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e Jul 30 16:39:10 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:10 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3920c021-f028-4b9f-9e2f-b04a3125c96e" returned: 0 in 0.458s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Lock "cinder-quobyte-3920c021-f028-4b9f-9e2f-b04a3125c96e" released by "delete_volume" :: held 1.137s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Created reservations ['4123144e-2c3c-4677-98de-b2b35b8599b7', 'a33c98be-f039-4cc7-8816-d99b527bd822', 'e5a124d6-2f11-4c67-b706-ae982b4560a1', '9281abef-34e5-4148-8d89-e6df51c139ee'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:10 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:39:10 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:10 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:10 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Deleted volume successfully. Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ef63252d-86eb-4bf6-bd77-10faf2ad3c82 tempest-VolumesCloneNegativeTest-1133574432 None] Lock "cinder-3920c021-f028-4b9f-9e2f-b04a3125c96e-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "cinder-74b6592d-b625-46d7-b6d8-b0eec2072e47-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Lock "cinder-74b6592d-b625-46d7-b6d8-b0eec2072e47-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "cinder-quobyte-74b6592d-b625-46d7-b6d8-b0eec2072e47" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Lock "cinder-quobyte-74b6592d-b625-46d7-b6d8-b0eec2072e47" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed9510d-e600-4642-92dc-4bd7c50e631d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:11 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 Jul 30 16:39:11 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:11 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47" returned: 0 in 0.419s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:11 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47 Jul 30 16:39:11 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:12 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-74b6592d-b625-46d7-b6d8-b0eec2072e47" returned: 0 in 0.368s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Lock "cinder-quobyte-74b6592d-b625-46d7-b6d8-b0eec2072e47" released by "delete_volume" :: held 0.838s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Created reservations ['8d0c2b50-11b4-4681-b618-30de806bbe1d', 'e3d71ca5-b940-4f30-994c-980a80b81e93', '05b0a12f-ffe0-441d-b4a9-ff9a7de489d1', '562d410e-1b6f-453b-90f1-dc78655aaa9c'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:12 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:39:12 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:12 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.509s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Deleted volume successfully. Jul 30 16:39:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ddd09633-6229-4d09-bdfb-9efbf04339a0 tempest-ServerActionsTestOtherA-1074613001 None] Lock "cinder-74b6592d-b625-46d7-b6d8-b0eec2072e47-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:39:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea0644f-9f36-4c3f-9821-26f38a6a7f9a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:14 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:39:14 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:15 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.641s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e88da-e329-49bd-bd69-619b41410504]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:15 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:39:15 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:15 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.494s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.733de6fd-eea0-470e-94a5-936ac77f86c3o9liy4gt.img {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:15 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.733de6fd-eea0-470e-94a5-936ac77f86c3o9liy4gt.img Jul 30 16:39:15 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Flow 'volume_create_manager' (cb4cdaec-f692-4bd2-8b4a-e3a82bd69358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390aefc7-2c28-4217-8f18-b7a56df19326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390aefc7-2c28-4217-8f18-b7a56df19326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-749840162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7704dffc-5021-44d8-a95d-52441194a5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b91a082127e466abdab5de8a43932ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:18Z,use_quota=True,user_id='5672ef56737f46e087bb24948000d2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871bd3e7-aaa3-4d18-bca9-84620e8ff9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871bd3e7-aaa3-4d18-bca9-84620e8ff9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721a3616-ef5c-4b54-b420-ef5303fdac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:18 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:39:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721a3616-ef5c-4b54-b420-ef5303fdac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7704dffc-5021-44d8-a95d-52441194a5e1', 'volume_name': 'volume-7704dffc-5021-44d8-a95d-52441194a5e1', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59e4c45-3e80-46fc-9f11-e146694c9260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59e4c45-3e80-46fc-9f11-e146694c9260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d355b4-5630-48ff-909a-da980a948978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:19 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Volume 7704dffc-5021-44d8-a95d-52441194a5e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7704dffc-5021-44d8-a95d-52441194a5e1', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:39:19 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Trying to clone 7704dffc-5021-44d8-a95d-52441194a5e1 from image e99749b8-1b47-4194-9cb3-562081ac77f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:39:20 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:39:20 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:39:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f20d142-2b1c-4a3d-8d0b-87c32dc4ded7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:20 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD Jul 30 16:39:20 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:21 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD" returned: 0 in 0.556s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 is fetched for user 5672ef56737f46e087bb24948000d2a0. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790bad0-c76d-4a97-98cd-5e8a5f8d1cf1]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:21 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.733de6fd-eea0-470e-94a5-936ac77f86c3o9liy4gt.img" returned: 0 in 5.883s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[16382d5a-df74-44e3-9718-02fc616d7365]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:21 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD Jul 30 16:39:21 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:21 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:39:21 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:21 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:22 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.623s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:22 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.733de6fd-eea0-470e-94a5-936ac77f86c3o9liy4gt.img {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:39:22 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Converted 1024.00 MB image at 174.01 MB/s Jul 30 16:39:22 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] 733de6fd-eea0-470e-94a5-936ac77f86c3 was raw, no need to convert to raw {{(pid=88380) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 16:39:32 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=42,cinder:INSERT=14,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:39:32 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=60,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=3 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:39:46 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:39:46 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.332s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Uploaded volume to glance image-id: 733de6fd-eea0-470e-94a5-936ac77f86c3. {{(pid=88380) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-749840162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7704dffc-5021-44d8-a95d-52441194a5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b91a082127e466abdab5de8a43932ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:39:18Z,use_quota=True,user_id='5672ef56737f46e087bb24948000d2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Creating volume 7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:39:48 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:39:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:48 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 1073741824 Jul 30 16:39:48 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-687fea78-5379-4a17-a490-14f2cecdf340 tempest-VolumesActionsTest-1032088384 None] Copy volume to image completed successfully. Jul 30 16:39:49 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 1073741824" returned: 0 in 0.594s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:49 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 Jul 30 16:39:49 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:50 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1" returned: 0 in 0.543s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Attempting download of e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume 7704dffc-5021-44d8-a95d-52441194a5e1. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d8686b-bd44-48bf-b782-0811031ae8af]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:50 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b Jul 30 16:39:50 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:50 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b" returned: 0 in 0.442s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[45121248-b180-4ac5-9a83-56edf34aee0b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:50 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b Jul 30 16:39:50 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:39:50 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:50 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:51 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b" returned: 1 in 0.472s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lony_n0b' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa88d7-16c8-4f64-8f2b-4b2abc5afe8c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:51 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.506s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[727b42c1-6661-4690-97f7-2823f0f4020d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:51 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD Jul 30 16:39:51 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:51 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:39:51 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:51 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD" returned: 0 in 0.676s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] e99749b8-1b47-4194-9cb3-562081ac77f1 was qcow2, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:39:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:51 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 Jul 30 16:39:51 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:52 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.784s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:52 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img Jul 30 16:39:52 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:39:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:54 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:39:54 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:55 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 1.229s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:39:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:39:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:39:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:39:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1" returned: 0 in 5.660s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:57 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_n7hleo90devstack@QuobyteHD, size 112.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:39:57 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Converted 112.00 MB image at 19.79 MB/s Jul 30 16:39:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:39:57 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 1G Jul 30 16:39:57 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:39:59 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 1G" returned: 0 in 1.528s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Downloaded image e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume 7704dffc-5021-44d8-a95d-52441194a5e1 successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 for user 5672ef56737f46e087bb24948000d2a0 is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Marking volume 7704dffc-5021-44d8-a95d-52441194a5e1 as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Copying metadata from image e99749b8-1b47-4194-9cb3-562081ac77f1 to 7704dffc-5021-44d8-a95d-52441194a5e1. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Creating volume glance metadata for volume 7704dffc-5021-44d8-a95d-52441194a5e1 backed by image e99749b8-1b47-4194-9cb3-562081ac77f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d355b4-5630-48ff-909a-da980a948978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7704dffc-5021-44d8-a95d-52441194a5e1', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519a10ba-b570-4ccd-ad90-5110feac2499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:39:59 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Volume volume-7704dffc-5021-44d8-a95d-52441194a5e1 (7704dffc-5021-44d8-a95d-52441194a5e1): created successfully Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519a10ba-b570-4ccd-ad90-5110feac2499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:39:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Flow 'volume_create_manager' (cb4cdaec-f692-4bd2-8b4a-e3a82bd69358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:39:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1d2c1d3b-e714-4567-b1a8-5514c611dcd0 tempest-VolumesExtendTest-571700395 None] Created volume successfully. Jul 30 16:40:00 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img" returned: 0 in 8.321s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:00 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e44d105-f278-4488-9777-c3c93414fb97]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:00 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:40:00 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:01 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.882s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:40:01 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Converted 1024.00 MB image at 123.00 MB/s Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] 96119618-03c6-4206-9b4f-7b96712abf40 was raw, converting to qcow2 {{(pid=88380) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8886323-afc4-4d39-b188-51b360b3af65]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:01 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img Jul 30 16:40:01 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:01 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img" returned: 0 in 0.459s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:01 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img Jul 30 16:40:01 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img" returned: 1 in 0.496s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:40:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img /opt/stack/data/cinder/conversion/vol_upload_aueh18qb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:02 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:02 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img /opt/stack/data/cinder/conversion/vol_upload_aueh18qb Jul 30 16:40:02 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:03 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img /opt/stack/data/cinder/conversion/vol_upload_aueh18qb" returned: 0 in 0.750s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:03 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Image conversion details: src /opt/stack/data/cinder/conversion/f8077d7b-aecb-44de-a58b-327f8594ae82.temp_image.96119618-03c6-4206-9b4f-7b96712abf40utc_cr2_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_aueh18qb {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:40:03 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 30 16:40:03 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f10ae4d-18cf-4dcc-8c7c-ba83b12d540f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_aueh18qb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:03 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_aueh18qb Jul 30 16:40:03 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:03 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_aueh18qb" returned: 0 in 0.835s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.369s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Uploaded volume to glance image-id: 96119618-03c6-4206-9b4f-7b96712abf40. {{(pid=88380) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.554s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a89dd-cf13-4d02-a54f-068039b002d5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-717bee0f-ccf6-4a38-918c-531395551982 tempest-VolumesActionsTest-1032088384 None] Copy volume to image completed successfully. Jul 30 16:40:06 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 Jul 30 16:40:06 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:06 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1" returned: 0 in 0.518s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 2G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 2G" returned: 0 in 0.140s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.692s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a0670aa6-2605-4151-9850-783c55e0d688 tempest-VolumesExtendTest-571700395 None] Extend volume completed successfully. Jul 30 16:40:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-7704dffc-5021-44d8-a95d-52441194a5e1-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Lock "cinder-7704dffc-5021-44d8-a95d-52441194a5e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-quobyte-7704dffc-5021-44d8-a95d-52441194a5e1" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-7704dffc-5021-44d8-a95d-52441194a5e1" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb549cc3-0800-4cd1-be69-6228400720cd]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:07 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 Jul 30 16:40:07 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "cinder-quobyte-f8077d7b-aecb-44de-a58b-327f8594ae82" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-quobyte-f8077d7b-aecb-44de-a58b-327f8594ae82" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9351ed16-1752-40fd-8645-95332ccaaa2e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:08 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1" returned: 0 in 0.553s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:08 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1 Jul 30 16:40:08 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:08 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:40:08 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:08 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7704dffc-5021-44d8-a95d-52441194a5e1" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-7704dffc-5021-44d8-a95d-52441194a5e1" released by "delete_volume" :: held 0.902s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Created reservations ['23d32b39-042e-4030-93ad-668ca9db8a8a', '8c230662-c354-49f1-a6f7-72b75457d0c5', '5013fee3-aba0-47fc-a1af-609b63a27165', 'e99e50fe-4284-4b47-8797-1628cbcfef82'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:08 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.538s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:08 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:08 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:08 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82 Jul 30 16:40:08 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:09 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f8077d7b-aecb-44de-a58b-327f8594ae82" returned: 0 in 0.331s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:09 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-quobyte-f8077d7b-aecb-44de-a58b-327f8594ae82" released by "delete_volume" :: held 0.967s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Deleted volume successfully. Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a1efb143-2fc2-4132-acc9-d2660e025e7c tempest-VolumesExtendTest-571700395 None] Lock "cinder-7704dffc-5021-44d8-a95d-52441194a5e1-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Created reservations ['db0b4644-1105-44fd-b148-c5a2cba1afb9', 'b9ec6b76-5e5b-492d-aff8-3e4a366da098', '335a5505-20f6-40bc-8578-2c9416215db1', '4cc13338-9e87-4190-8f42-fbac4b9b8fd9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:09 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:09 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Flow 'volume_create_manager' (3fc6e4ee-5f10-4823-8d2d-935d75c86797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d190c147-56ff-43e5-8388-a111f51648d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d190c147-56ff-43e5-8388-a111f51648d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1976641372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde44e15-629f-4a2c-8003-6d00d3376cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b91a082127e466abdab5de8a43932ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:09Z,use_quota=True,user_id='5672ef56737f46e087bb24948000d2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210bc5bb-d56d-4cbb-9bca-7db16606f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210bc5bb-d56d-4cbb-9bca-7db16606f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c28682b-a060-4ede-a13b-3fe48b7e17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c28682b-a060-4ede-a13b-3fe48b7e17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde44e15-629f-4a2c-8003-6d00d3376cc7', 'volume_name': 'volume-bde44e15-629f-4a2c-8003-6d00d3376cc7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e940d1f9-4d93-4464-89a3-fd76638007ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e940d1f9-4d93-4464-89a3-fd76638007ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49692a27-7767-4da3-ba20-16c75f93e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:09 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Volume bde44e15-629f-4a2c-8003-6d00d3376cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde44e15-629f-4a2c-8003-6d00d3376cc7', 'volume_size': 1} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1976641372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde44e15-629f-4a2c-8003-6d00d3376cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b91a082127e466abdab5de8a43932ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:09Z,use_quota=True,user_id='5672ef56737f46e087bb24948000d2a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Creating volume bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:09 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:09 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 1073741824 Jul 30 16:40:09 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:09 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.301s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Deleted volume successfully. Jul 30 16:40:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-752f6689-1c65-4f2e-8c89-268ed78e9ac4 tempest-VolumesActionsTest-1032088384 None] Lock "cinder-f8077d7b-aecb-44de-a58b-327f8594ae82-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:10 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 1073741824" returned: 0 in 0.557s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:10 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 Jul 30 16:40:10 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:10 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7" returned: 0 in 0.350s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49692a27-7767-4da3-ba20-16c75f93e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde44e15-629f-4a2c-8003-6d00d3376cc7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0619fab6-1d85-45be-9cf0-63c80827cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:10 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Volume volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 (bde44e15-629f-4a2c-8003-6d00d3376cc7): created successfully Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0619fab6-1d85-45be-9cf0-63c80827cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Flow 'volume_create_manager' (3fc6e4ee-5f10-4823-8d2d-935d75c86797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-662a437b-ead9-4d91-938c-d7c824c1b12d tempest-VolumesExtendTest-571700395 None] Created volume successfully. Jul 30 16:40:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Creating offline snapshot 11fdea47-53fc-4b40-a429-51bdb317d29a of volume bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:40:11 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d948c4b4-068e-4739-9fbe-d71142abb421]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:12 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 Jul 30 16:40:12 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:12 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7" returned: 0 in 0.546s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:12 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a 1G Jul 30 16:40:12 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:13 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a 1G" returned: 0 in 0.568s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:13 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a Jul 30 16:40:13 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:13 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a" returned: 0 in 0.367s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:13 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a is being set with open permissions: ugo+rw Jul 30 16:40:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:13 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a Jul 30 16:40:13 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:13 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:13 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info Jul 30 16:40:13 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:14 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info" returned: 0 in 0.443s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:14 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info is being set with open permissions: ugo+rw Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:14 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info Jul 30 16:40:14 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:14 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.info" returned: 0 in 0.527s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.910s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Flow 'volume_create_manager' (3c0c7591-118e-4ccb-9a2b-150b7014119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c70212-d65c-45aa-b7d0-5d3296f96833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-cff70fa6-7a7b-40de-af8a-a54a9fae1a95 tempest-VolumesExtendTest-571700395 None] Create snapshot completed successfully Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c70212-d65c-45aa-b7d0-5d3296f96833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1727505771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e28082e-8204-4670-8ee5-b274146ae322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45759f04aba046df998bca719c4989c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:15Z,use_quota=True,user_id='320ea4c9b43a4633839a728f821ad1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1e139e-84a3-44ab-be78-6e4d004a8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1e139e-84a3-44ab-be78-6e4d004a8395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219b8708-2dd3-4307-ac36-ab542b5a155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219b8708-2dd3-4307-ac36-ab542b5a155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e28082e-8204-4670-8ee5-b274146ae322', 'volume_name': 'volume-6e28082e-8204-4670-8ee5-b274146ae322', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4d59ef-25d2-43e2-8e62-a2a67e30ac5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4d59ef-25d2-43e2-8e62-a2a67e30ac5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c153a5d-459d-4435-94c9-f1c655769d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Volume 6e28082e-8204-4670-8ee5-b274146ae322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e28082e-8204-4670-8ee5-b274146ae322', 'volume_size': 1} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1727505771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e28082e-8204-4670-8ee5-b274146ae322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45759f04aba046df998bca719c4989c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:15Z,use_quota=True,user_id='320ea4c9b43a4633839a728f821ad1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Creating volume 6e28082e-8204-4670-8ee5-b274146ae322 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:14 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:14 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 1073741824 Jul 30 16:40:14 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:15 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 1073741824" returned: 0 in 0.580s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:15 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 Jul 30 16:40:15 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:15 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.560s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c153a5d-459d-4435-94c9-f1c655769d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e28082e-8204-4670-8ee5-b274146ae322', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52ff258-8dcd-4832-b702-494257ca0044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36b94f7-e325-4906-8561-a59ed37f83eb]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:16 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Volume volume-6e28082e-8204-4670-8ee5-b274146ae322 (6e28082e-8204-4670-8ee5-b274146ae322): created successfully Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d52ff258-8dcd-4832-b702-494257ca0044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Flow 'volume_create_manager' (3c0c7591-118e-4ccb-9a2b-150b7014119f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-54d3d09f-b1bb-4d34-8133-edbbf68ea325 tempest-AttachVolumeShelveTestJSON-424503945 None] Created volume successfully. Jul 30 16:40:16 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 Jul 30 16:40:16 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:16 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7" returned: 0 in 0.537s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a 2G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a 2G" returned: 0 in 0.187s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.855s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-16317061-ff11-4dbd-a002-b177a9144132 tempest-VolumesExtendTest-571700395 None] Extend volume completed successfully. Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-11fdea47-53fc-4b40-a429-51bdb317d29a-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Lock "cinder-11fdea47-53fc-4b40-a429-51bdb317d29a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-quobyte-bde44e15-629f-4a2c-8003-6d00d3376cc7" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-bde44e15-629f-4a2c-8003-6d00d3376cc7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-quobyte-11fdea47-53fc-4b40-a429-51bdb317d29a" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-11fdea47-53fc-4b40-a429-51bdb317d29a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Deleting offline snapshot 11fdea47-53fc-4b40-a429-51bdb317d29a of volume bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] snapshot_file for this snap is: volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ede4c7-5bc5-481c-9db1-c5e3a7e0cae7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:18 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a Jul 30 16:40:18 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:18 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a" returned: 0 in 0.571s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde44e15-629f-4a2c-8003-6d00d3376cc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:40:18 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89be5c4-22ad-4526-a6d5-3e602749c26d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:18 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 Jul 30 16:40:18 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:19 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7" returned: 0 in 0.633s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:19 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a Jul 30 16:40:19 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:19 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a" returned: 0 in 0.532s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:19 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a Jul 30 16:40:19 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:20 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7.11fdea47-53fc-4b40-a429-51bdb317d29a" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-11fdea47-53fc-4b40-a429-51bdb317d29a" released by "_delete_snapshot" :: held 2.254s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-bde44e15-629f-4a2c-8003-6d00d3376cc7" released by "delete_snapshot" :: held 2.294s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:20 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Created reservations ['363fdbf8-2630-456c-b06c-000c51a3cb74', '9efd8862-3418-402e-be39-15dcce10736d', 'a36e1921-bc4a-47bc-b4d4-c0ae72f3f455', '9d557f1a-1eae-4c46-93ef-e9fe37fe563e'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:20 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Delete snapshot completed successfully. Jul 30 16:40:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b22fb54-b588-41df-9947-c13aa624b8c8 tempest-VolumesExtendTest-571700395 None] Lock "cinder-11fdea47-53fc-4b40-a429-51bdb317d29a-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-bde44e15-629f-4a2c-8003-6d00d3376cc7-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Lock "cinder-bde44e15-629f-4a2c-8003-6d00d3376cc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Acquiring lock "cinder-quobyte-bde44e15-629f-4a2c-8003-6d00d3376cc7" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-bde44e15-629f-4a2c-8003-6d00d3376cc7" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[31afc348-9013-4b90-a50c-24b3b0e89ba9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:21 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 Jul 30 16:40:21 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:21 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7" returned: 0 in 0.489s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:21 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7 Jul 30 16:40:21 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:22 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bde44e15-629f-4a2c-8003-6d00d3376cc7" returned: 0 in 0.336s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Lock "cinder-quobyte-bde44e15-629f-4a2c-8003-6d00d3376cc7" released by "delete_volume" :: held 0.934s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Created reservations ['97a309ba-0133-4914-bf5c-984677724c9f', '45ecb7a4-fa81-475a-accb-a5e7b1ff57d0', 'c0289ef5-849b-4532-b521-fd4ff6382abc', '72603c93-9776-48cb-b097-20a2ba14a0d2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:22 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:22 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:22 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Deleted volume successfully. Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0967b27f-d5d8-4fcf-bb98-58bbdd5446e7 tempest-VolumesExtendTest-571700395 None] Lock "cinder-bde44e15-629f-4a2c-8003-6d00d3376cc7-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Flow 'volume_create_manager' (1e54d601-c616-4b61-ac32-8310e70ca87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863f8bb1-a0cf-4fe3-a391-8c864a11b2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (863f8bb1-a0cf-4fe3-a391-8c864a11b2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-160121527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ad8166-7006-472a-a75b-e3a19503b2c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e2a03e88045199b4b481246d07c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:23Z,use_quota=True,user_id='059663288b644d959230120c1b1c9084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffacf2a1-b964-4b9e-9c1f-be440ff271f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffacf2a1-b964-4b9e-9c1f-be440ff271f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67af1e94-f520-44a4-9e18-819e6e2826a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67af1e94-f520-44a4-9e18-819e6e2826a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ad8166-7006-472a-a75b-e3a19503b2c5', 'volume_name': 'volume-41ad8166-7006-472a-a75b-e3a19503b2c5', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fce0f7-7832-4edb-98fc-227912c81b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fce0f7-7832-4edb-98fc-227912c81b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b230e8-9f05-435c-b674-fc1a0c276d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:22 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Volume 41ad8166-7006-472a-a75b-e3a19503b2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ad8166-7006-472a-a75b-e3a19503b2c5', 'volume_size': 1} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-160121527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ad8166-7006-472a-a75b-e3a19503b2c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e2a03e88045199b4b481246d07c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:23Z,use_quota=True,user_id='059663288b644d959230120c1b1c9084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Creating volume 41ad8166-7006-472a-a75b-e3a19503b2c5 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:22 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:22 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 1073741824 Jul 30 16:40:22 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:23 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 1073741824" returned: 0 in 0.501s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:23 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 Jul 30 16:40:23 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:23 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5" returned: 0 in 0.336s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b230e8-9f05-435c-b674-fc1a0c276d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ad8166-7006-472a-a75b-e3a19503b2c5', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa9655f-b578-41e1-8dd0-437c4497f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:23 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Volume volume-41ad8166-7006-472a-a75b-e3a19503b2c5 (41ad8166-7006-472a-a75b-e3a19503b2c5): created successfully Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa9655f-b578-41e1-8dd0-437c4497f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Flow 'volume_create_manager' (1e54d601-c616-4b61-ac32-8310e70ca87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9aed5749-b091-4b59-aafc-8dc853c158fe tempest-VolumesListTestJSON-525362873 None] Created volume successfully. Jul 30 16:40:25 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Flow 'volume_create_manager' (0dc3dad1-a17d-47c3-b98c-1d82eabc7bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9394a54-b5fe-437b-aec7-037a237d8814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9394a54-b5fe-437b-aec7-037a237d8814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-908714232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ace57-a786-458c-9f47-515e7a0a6466,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e2a03e88045199b4b481246d07c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:26Z,use_quota=True,user_id='059663288b644d959230120c1b1c9084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc455a4-dac2-40ad-873e-9014405f8340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc455a4-dac2-40ad-873e-9014405f8340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236dfb92-f46a-4a39-bd5e-25c410fd8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (236dfb92-f46a-4a39-bd5e-25c410fd8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15ace57-a786-458c-9f47-515e7a0a6466', 'volume_name': 'volume-d15ace57-a786-458c-9f47-515e7a0a6466', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014eb07a-7d60-46c9-9313-2f8632e6329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (014eb07a-7d60-46c9-9313-2f8632e6329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a08907-5dc9-4d66-a7cf-e1ed7f20408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:26 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Volume d15ace57-a786-458c-9f47-515e7a0a6466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15ace57-a786-458c-9f47-515e7a0a6466', 'volume_size': 1} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-908714232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15ace57-a786-458c-9f47-515e7a0a6466,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e2a03e88045199b4b481246d07c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:26Z,use_quota=True,user_id='059663288b644d959230120c1b1c9084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Creating volume d15ace57-a786-458c-9f47-515e7a0a6466 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:26 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:26 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 1073741824 Jul 30 16:40:26 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:26 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 1073741824" returned: 0 in 0.684s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:27 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 Jul 30 16:40:27 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:27 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a08907-5dc9-4d66-a7cf-e1ed7f20408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15ace57-a786-458c-9f47-515e7a0a6466', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fce903e-e091-4d41-8f91-84a94e98c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:27 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Volume volume-d15ace57-a786-458c-9f47-515e7a0a6466 (d15ace57-a786-458c-9f47-515e7a0a6466): created successfully Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fce903e-e091-4d41-8f91-84a94e98c681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Flow 'volume_create_manager' (0dc3dad1-a17d-47c3-b98c-1d82eabc7bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-94f04367-3abe-4f5e-a11f-ec0a963ec6e4 tempest-VolumesListTestJSON-525362873 None] Created volume successfully. Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (347d92e8-fd9f-4702-857a-9ab9d24b1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a170ef-5494-46cb-94e4-0e426160009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28a170ef-5494-46cb-94e4-0e426160009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-6385843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce70713-bc80-419f-9a46-eaf2004987c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:28Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c37c03f-fadf-4f86-b4dd-9cbd6647e0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c37c03f-fadf-4f86-b4dd-9cbd6647e0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3117c7b8-8aeb-4411-b025-038bda7c021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3117c7b8-8aeb-4411-b025-038bda7c021a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce70713-bc80-419f-9a46-eaf2004987c4', 'volume_name': 'volume-1ce70713-bc80-419f-9a46-eaf2004987c4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c54321b-f5b0-47b3-b4aa-8da941f56d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c54321b-f5b0-47b3-b4aa-8da941f56d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1044fd0-1b25-4e4f-9218-2177599e78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Volume 1ce70713-bc80-419f-9a46-eaf2004987c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce70713-bc80-419f-9a46-eaf2004987c4', 'volume_size': 1} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-6385843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce70713-bc80-419f-9a46-eaf2004987c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:28Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Creating volume 1ce70713-bc80-419f-9a46-eaf2004987c4 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:28 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:28 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 1073741824 Jul 30 16:40:28 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Flow 'volume_create_manager' (5d4dd3c7-f0b4-4edb-91e9-2261cc2e0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b854054-fde4-408b-9c19-207ebdce1b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b854054-fde4-408b-9c19-207ebdce1b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-249470968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2309b4-859d-44e6-a8fe-fc0c52cb938a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e16a383b74b1b92054169e202922e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:28Z,use_quota=True,user_id='7011e23c8c2f4b498f63910b4c2b77f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc630b2b-7892-4db9-8cd5-55a084da4da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc630b2b-7892-4db9-8cd5-55a084da4da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28964234-1e7f-4003-a406-0b60847d1fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28964234-1e7f-4003-a406-0b60847d1fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2309b4-859d-44e6-a8fe-fc0c52cb938a', 'volume_name': 'volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4ab4e1-9e8d-4fdc-b123-6973aafc7953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4ab4e1-9e8d-4fdc-b123-6973aafc7953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb997acc-7b96-4840-a6e4-1faaeb4e83f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Volume ef2309b4-859d-44e6-a8fe-fc0c52cb938a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a', 'volume_size': 1} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:28 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 1073741824" returned: 0 in 0.629s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:28 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 Jul 30 16:40:28 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Flow 'volume_create_manager' (ff6d5551-12f9-452a-adbb-02447f452ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd429a7e-fbac-4150-95ce-233713f9cbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-fd208ed1-7d03-4af4-9a8b-e34fe8279025 req-71ec57e0-0a9f-4876-8a09-c4cabda7c6ca tempest-AttachVolumeShelveTestJSON-424503945 None] No connector for attachment 7a86a317-ef5b-4eb5-8caa-6a366aedf738; skipping storage backend terminate_connection call. {{(pid=88380) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-fd208ed1-7d03-4af4-9a8b-e34fe8279025 req-71ec57e0-0a9f-4876-8a09-c4cabda7c6ca tempest-AttachVolumeShelveTestJSON-424503945 None] Deleting attachment 7a86a317-ef5b-4eb5-8caa-6a366aedf738. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd429a7e-fbac-4150-95ce-233713f9cbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-418322573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d3bfe7-9577-4cfd-8b6d-704fc567dbc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e2a03e88045199b4b481246d07c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:29Z,use_quota=True,user_id='059663288b644d959230120c1b1c9084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012f2ecc-b0fb-462d-a526-12b7c1f9e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012f2ecc-b0fb-462d-a526-12b7c1f9e048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6fd358-05ed-4b9a-a1b0-0cbaf927afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6fd358-05ed-4b9a-a1b0-0cbaf927afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d3bfe7-9577-4cfd-8b6d-704fc567dbc4', 'volume_name': 'volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab86c4af-ef3a-4af8-b5fd-f95951732e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab86c4af-ef3a-4af8-b5fd-f95951732e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435e9430-8a03-4ce1-aae6-18f0dab4c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:29 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Volume 97d3bfe7-9577-4cfd-8b6d-704fc567dbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4', 'volume_size': 1} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:29 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4" returned: 0 in 0.269s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-249470968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2309b4-859d-44e6-a8fe-fc0c52cb938a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e16a383b74b1b92054169e202922e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:28Z,use_quota=True,user_id='7011e23c8c2f4b498f63910b4c2b77f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Creating volume ef2309b4-859d-44e6-a8fe-fc0c52cb938a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:29 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1044fd0-1b25-4e4f-9218-2177599e78ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce70713-bc80-419f-9a46-eaf2004987c4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0e7cd-8a3d-421d-8542-3846c7ba6623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:29 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a 1073741824 Jul 30 16:40:29 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:29 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Volume volume-1ce70713-bc80-419f-9a46-eaf2004987c4 (1ce70713-bc80-419f-9a46-eaf2004987c4): created successfully Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d0e7cd-8a3d-421d-8542-3846c7ba6623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (347d92e8-fd9f-4702-857a-9ab9d24b1592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-af646005-b793-459a-9d29-f0c9ebf25cf3 tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:40:29 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a 1073741824" returned: 0 in 0.601s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:29 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a Jul 30 16:40:29 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:30 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-418322573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d3bfe7-9577-4cfd-8b6d-704fc567dbc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='336e2a03e88045199b4b481246d07c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:29Z,use_quota=True,user_id='059663288b644d959230120c1b1c9084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Creating volume 97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:30 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb997acc-7b96-4840-a6e4-1faaeb4e83f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:30 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 1073741824 Jul 30 16:40:30 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eed7ba3-574d-4e68-b12a-dcf3d404e080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:30 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Volume volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a (ef2309b4-859d-44e6-a8fe-fc0c52cb938a): created successfully Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eed7ba3-574d-4e68-b12a-dcf3d404e080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Flow 'volume_create_manager' (5d4dd3c7-f0b4-4edb-91e9-2261cc2e0071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:30 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c70cb2a4-1ba7-4285-bcaf-235af86124e6 tempest-AttachVolumeTestJSON-954158415 None] Created volume successfully. Jul 30 16:40:30 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 1073741824" returned: 0 in 0.635s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:30 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 Jul 30 16:40:30 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:31 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4" returned: 0 in 0.369s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435e9430-8a03-4ce1-aae6-18f0dab4c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b3e163-1223-42a2-8eeb-5e62a5b50656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Volume volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 (97d3bfe7-9577-4cfd-8b6d-704fc567dbc4): created successfully Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b3e163-1223-42a2-8eeb-5e62a5b50656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Flow 'volume_create_manager' (ff6d5551-12f9-452a-adbb-02447f452ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2cb9b89d-f113-4d5c-bbe8-34b66e4b033b tempest-VolumesListTestJSON-525362873 None] Created volume successfully. Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (c2fdd77d-2b35-4128-b6fb-a72af0575465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c4fac-8e13-475e-96c0-1e800097ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570c4fac-8e13-475e-96c0-1e800097ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-872164681',display_name='tempest-VolumesGetTest-Volume-1456664489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b443283f-74fb-4038-9010-80608da29a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:31Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e74fa2e-e5e6-4571-8006-6761fa70b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e74fa2e-e5e6-4571-8006-6761fa70b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d463de-0b32-47d8-8d45-4c3cc53c7aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d463de-0b32-47d8-8d45-4c3cc53c7aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b443283f-74fb-4038-9010-80608da29a89', 'volume_name': 'volume-b443283f-74fb-4038-9010-80608da29a89', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97ccdba-61c4-4e61-ac4d-91ee651f15cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b97ccdba-61c4-4e61-ac4d-91ee651f15cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6281fa57-00a5-404e-9b69-4f49625fd0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Volume b443283f-74fb-4038-9010-80608da29a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b443283f-74fb-4038-9010-80608da29a89', 'volume_size': 1} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-872164681',display_name='tempest-VolumesGetTest-Volume-1456664489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b443283f-74fb-4038-9010-80608da29a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:31Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Creating volume b443283f-74fb-4038-9010-80608da29a89 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:31 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:31 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 1073741824 Jul 30 16:40:31 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-b932f79c-3f82-46e0-a5d0-1569c090feea req-f168fbaa-9269-4574-a6b3-74322e85e101 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:31 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 1073741824" returned: 0 in 0.548s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:32 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 Jul 30 16:40:32 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:32 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-b932f79c-3f82-46e0-a5d0-1569c090feea req-f168fbaa-9269-4574-a6b3-74322e85e101 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.822s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6281fa57-00a5-404e-9b69-4f49625fd0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b443283f-74fb-4038-9010-80608da29a89', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc2b32c-4ef8-4bb4-b223-0aae4d692638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-b932f79c-3f82-46e0-a5d0-1569c090feea req-f168fbaa-9269-4574-a6b3-74322e85e101 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:32 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Volume volume-b443283f-74fb-4038-9010-80608da29a89 (b443283f-74fb-4038-9010-80608da29a89): created successfully Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc2b32c-4ef8-4bb4-b223-0aae4d692638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (c2fdd77d-2b35-4128-b6fb-a72af0575465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-221e2d53-fd14-4951-8ca0-248b85b9ad68 tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:40:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-b932f79c-3f82-46e0-a5d0-1569c090feea req-f168fbaa-9269-4574-a6b3-74322e85e101 tempest-AttachVolumeTestJSON-954158415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa50580d-7e27-4df6-87e0-d2fb7876daa0', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:40:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-b932f79c-3f82-46e0-a5d0-1569c090feea req-f168fbaa-9269-4574-a6b3-74322e85e101 tempest-AttachVolumeTestJSON-954158415 None] attachment_update completed successfully. Jul 30 16:40:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-b443283f-74fb-4038-9010-80608da29a89-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Lock "cinder-b443283f-74fb-4038-9010-80608da29a89-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-b443283f-74fb-4038-9010-80608da29a89" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-b443283f-74fb-4038-9010-80608da29a89" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:33 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b71546b-b1cf-4203-b22a-54d8d877507e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:33 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 Jul 30 16:40:33 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:34 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89" returned: 0 in 0.593s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:34 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89 Jul 30 16:40:34 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:34 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b443283f-74fb-4038-9010-80608da29a89" returned: 0 in 0.317s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-b443283f-74fb-4038-9010-80608da29a89" released by "delete_volume" :: held 0.979s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Created reservations ['9995a02d-f8d2-4442-8ddb-9cb5d5f162d7', '3ca1fd6d-e09e-43a2-b2ba-8cc03cdaaefb', 'dd6d21e1-e972-49b4-a388-167e8b2b1ead', '20a44a24-3a1f-43f8-884e-bd7efcb6a272'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:34 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:34 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Acquiring lock "cinder-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Lock "cinder-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Acquiring lock "cinder-quobyte-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Lock "cinder-quobyte-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b85cef-cb4e-4633-a302-e2d86d49924b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:35 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.424s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-81471847-fa3c-4713-8061-e4cdba8e2c9d tempest-VolumesGetTest-1060828599 None] Lock "cinder-b443283f-74fb-4038-9010-80608da29a89-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:35 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 Jul 30 16:40:35 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:35 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4" returned: 0 in 0.508s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:35 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4 Jul 30 16:40:35 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-1ce70713-bc80-419f-9a46-eaf2004987c4-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Lock "cinder-1ce70713-bc80-419f-9a46-eaf2004987c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:36 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4" returned: 0 in 0.269s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Lock "cinder-quobyte-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4" released by "delete_volume" :: held 0.833s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-1ce70713-bc80-419f-9a46-eaf2004987c4" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-1ce70713-bc80-419f-9a46-eaf2004987c4" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Created reservations ['60ee7c29-aec3-4006-a4cb-43083e34ed70', '36f33c97-4b05-425c-8348-35f08b16df38', '8c954aa0-2733-4e50-bab4-dda5ec943bc6', '18f1a059-842e-452b-8956-dac3777d6d1d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[34262c1b-33ea-473f-9bcf-81e035cef526]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:36 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:36 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:36 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 Jul 30 16:40:36 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:36 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.277s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Deleted volume successfully. Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e361f50-4c0c-467e-8146-1b82c2a0fb3e tempest-VolumesListTestJSON-525362873 None] Lock "cinder-97d3bfe7-9577-4cfd-8b6d-704fc567dbc4-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:36 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4" returned: 0 in 0.485s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:36 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4 Jul 30 16:40:36 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:36 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1ce70713-bc80-419f-9a46-eaf2004987c4" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-1ce70713-bc80-419f-9a46-eaf2004987c4" released by "delete_volume" :: held 0.854s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Created reservations ['509e2d8e-2cec-46cc-9c9c-ca2592858135', '5e48a01b-e982-46ef-b0cc-75cfbf2cdc21', 'a0dc7a8b-c64d-4b56-892f-641ee08cca46', 'f62f1c7a-0ed6-40f3-baa9-987115d5803d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:37 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:37 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "cinder-d15ace57-a786-458c-9f47-515e7a0a6466-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-d15ace57-a786-458c-9f47-515e7a0a6466-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "cinder-quobyte-d15ace57-a786-458c-9f47-515e7a0a6466" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-quobyte-d15ace57-a786-458c-9f47-515e7a0a6466" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[02017b2f-c788-46aa-b273-da13a05d62eb]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:37 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.537s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:37 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:40:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-195d7dd5-2f2b-4180-a9fb-41a0aa9d8126 tempest-VolumesGetTest-1060828599 None] Lock "cinder-1ce70713-bc80-419f-9a46-eaf2004987c4-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:37 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 Jul 30 16:40:37 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (12286128-fdff-41e2-be88-40de27b41761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22776fc1-d615-487f-96bb-82dc066e5b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22776fc1-d615-487f-96bb-82dc066e5b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-61687970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e045e2-72b2-472f-9527-feb484d351a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:38Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217dba39-5ce2-476a-a1dd-ca23da2bdb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (217dba39-5ce2-476a-a1dd-ca23da2bdb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4086c515-d295-486b-aadb-d3db256a0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4086c515-d295-486b-aadb-d3db256a0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e045e2-72b2-472f-9527-feb484d351a3', 'volume_name': 'volume-00e045e2-72b2-472f-9527-feb484d351a3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9d4a84-e906-4bc7-8cfc-ee771b6c4498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9d4a84-e906-4bc7-8cfc-ee771b6c4498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af9ff9a-0b11-466d-a48b-a300efa5f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Volume 00e045e2-72b2-472f-9527-feb484d351a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e045e2-72b2-472f-9527-feb484d351a3', 'volume_size': 1} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-61687970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e045e2-72b2-472f-9527-feb484d351a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:38Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Creating volume 00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:38 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:38 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 1073741824 Jul 30 16:40:38 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:38 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466" returned: 0 in 0.816s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:38 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466 Jul 30 16:40:38 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d15ace57-a786-458c-9f47-515e7a0a6466" returned: 0 in 0.463s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-quobyte-d15ace57-a786-458c-9f47-515e7a0a6466" released by "delete_volume" :: held 1.371s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:38 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Created reservations ['f2456933-f7d7-45ab-a46c-2a2b53d311d4', 'b24b3edc-2436-41fd-a8a2-6e43a405edeb', '631895b2-bbc1-4076-8c28-cbcff00fe46b', '88eee1b3-185b-4883-8020-3d42bb988acb'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:39 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 1073741824" returned: 0 in 0.852s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:39 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 Jul 30 16:40:39 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:39 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:39 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:39 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3" returned: 0 in 0.371s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af9ff9a-0b11-466d-a48b-a300efa5f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e045e2-72b2-472f-9527-feb484d351a3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc855b61-0bc4-4791-9bb1-45346f426914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Volume volume-00e045e2-72b2-472f-9527-feb484d351a3 (00e045e2-72b2-472f-9527-feb484d351a3): created successfully Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc855b61-0bc4-4791-9bb1-45346f426914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (12286128-fdff-41e2-be88-40de27b41761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b18fae80-f1e4-49b7-a613-b10bf0746f95 tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:40:39 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.428s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Deleted volume successfully. Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cdfd3ab0-5112-4ce0-a90f-c632fcef1e97 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-d15ace57-a786-458c-9f47-515e7a0a6466-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "cinder-41ad8166-7006-472a-a75b-e3a19503b2c5-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-41ad8166-7006-472a-a75b-e3a19503b2c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "cinder-quobyte-41ad8166-7006-472a-a75b-e3a19503b2c5" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-quobyte-41ad8166-7006-472a-a75b-e3a19503b2c5" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00a3f6-befa-4fc7-9407-ad682eb7dcb5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:40 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 Jul 30 16:40:40 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:41 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5" returned: 0 in 0.850s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:41 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5 Jul 30 16:40:41 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (76a5b86e-cb45-4d39-af16-e7d0aba0ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0acd12-87af-44f8-85d2-3d638450b6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0acd12-87af-44f8-85d2-3d638450b6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1036655625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20c1a01-284f-4a2b-8a6a-deee41661fa2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=00e045e2-72b2-472f-9527-feb484d351a3,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:41Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84aa6e6c-dbb1-4a6d-9cda-a7bbddb4e24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84aa6e6c-dbb1-4a6d-9cda-a7bbddb4e24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f65226b-e1e1-401a-afd4-ae157d3bdf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-41ad8166-7006-472a-a75b-e3a19503b2c5" returned: 0 in 0.536s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-quobyte-41ad8166-7006-472a-a75b-e3a19503b2c5" released by "delete_volume" :: held 1.480s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f65226b-e1e1-401a-afd4-ae157d3bdf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e20c1a01-284f-4a2b-8a6a-deee41661fa2', 'volume_name': 'volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2', 'volume_size': 1, 'source_volid': '00e045e2-72b2-472f-9527-feb484d351a3', 'source_volstatus': 'available'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e94a6c-b5e7-436f-8f65-0055f18ea679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e94a6c-b5e7-436f-8f65-0055f18ea679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e077969f-dc49-4fe3-b451-bf082e785766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:41 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Volume e20c1a01-284f-4a2b-8a6a-deee41661fa2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2', 'volume_size': 1, 'source_volid': '00e045e2-72b2-472f-9527-feb484d351a3', 'source_volstatus': 'available'} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:41 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Cloning volume 00e045e2-72b2-472f-9527-feb484d351a3 to volume e20c1a01-284f-4a2b-8a6a-deee41661fa2 Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Creating offline snapshot 6313c519-14a5-45bd-8429-5f693857f85a of volume 00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Created reservations ['b841a4ab-0624-4a32-8ebc-9dc2302b5aa7', '58f5e520-480f-4f9b-b2d2-19573b438271', '2a105fbd-b543-43fe-9463-0e11f52d266e', '28c789f7-fab6-4162-8009-5f3559eb5624'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8290ac50-7106-44b8-b18e-ea012944bc1c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:41 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:41 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:41 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 Jul 30 16:40:41 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:42 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.427s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:42 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Deleted volume successfully. Jul 30 16:40:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95e5e3ce-f21a-49f1-80b1-752e3d459913 tempest-VolumesListTestJSON-525362873 None] Lock "cinder-41ad8166-7006-472a-a75b-e3a19503b2c5-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:42 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3" returned: 0 in 0.703s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:42 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a 1G Jul 30 16:40:42 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:43 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a 1G" returned: 0 in 0.599s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e045e2-72b2-472f-9527-feb484d351a3 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:43 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e045e2-72b2-472f-9527-feb484d351a3 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a Jul 30 16:40:43 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:43 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00e045e2-72b2-472f-9527-feb484d351a3 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a" returned: 0 in 0.664s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:43 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a is being set with open permissions: ugo+rw Jul 30 16:40:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:43 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a Jul 30 16:40:43 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:44 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a" returned: 0 in 0.500s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:44 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info Jul 30 16:40:44 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:45 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info" returned: 0 in 0.748s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:45 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info is being set with open permissions: ugo+rw Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:45 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info Jul 30 16:40:45 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:45 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.info" returned: 0 in 0.571s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-e20c1a01-284f-4a2b-8a6a-deee41661fa2" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-e20c1a01-284f-4a2b-8a6a-deee41661fa2" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] snapshot: 6313c519-14a5-45bd-8429-5f693857f85a, volume: e20c1a01-284f-4a2b-8a6a-deee41661fa2, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe97b13-1bc3-4969-bf55-acc91c190c15]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:46 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a Jul 30 16:40:46 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:46 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a" returned: 0 in 0.459s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e045e2-72b2-472f-9527-feb484d351a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08bdd58-0da6-4102-b567-34eba57ddab5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:46 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 Jul 30 16:40:46 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:46 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3" returned: 0 in 0.600s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:40:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:46 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 Jul 30 16:40:46 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=105,cinder:SELECT=99,cinder:INSERT=32,cinder:DELETE=5 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=84,cinder:INSERT=29,cinder:UPDATE=116,cinder:DELETE=14 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:40:54 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2" returned: 0 in 7.500s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:40:54 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Converted 1024.00 MB image at 136.51 MB/s Jul 30 16:40:54 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 is being set with open permissions: ugo+rw Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:54 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 Jul 30 16:40:54 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:54 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:40:54 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:54 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2" returned: 0 in 0.417s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-e20c1a01-284f-4a2b-8a6a-deee41661fa2" released by "_copy_volume_from_snapshot" :: held 9.180s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-6313c519-14a5-45bd-8429-5f693857f85a" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-6313c519-14a5-45bd-8429-5f693857f85a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:40:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Deleting offline snapshot 6313c519-14a5-45bd-8429-5f693857f85a of volume 00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] snapshot_file for this snap is: volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed20b365-75c5-44d9-b8a4-3d696494374e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:55 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a Jul 30 16:40:55 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:55 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.624s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:40:55 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a" returned: 0 in 0.589s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00e045e2-72b2-472f-9527-feb484d351a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf25817-d243-4583-8f72-add4adb6fdd6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:40:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:55 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 Jul 30 16:40:55 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:56 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3" returned: 0 in 0.691s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:56 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a Jul 30 16:40:56 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:57 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a" returned: 0 in 0.616s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:57 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a Jul 30 16:40:57 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:40:57 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3.6313c519-14a5-45bd-8429-5f693857f85a" returned: 0 in 0.373s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-6313c519-14a5-45bd-8429-5f693857f85a" released by "_delete_snapshot" :: held 2.484s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.831s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e077969f-dc49-4fe3-b451-bf082e785766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2', 'volume_size': 1, 'source_volid': '00e045e2-72b2-472f-9527-feb484d351a3', 'source_volstatus': 'available'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd7beb7-94b7-4e27-86fc-b5396ae5f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:57 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Volume volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 (e20c1a01-284f-4a2b-8a6a-deee41661fa2): created successfully Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd7beb7-94b7-4e27-86fc-b5396ae5f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (76a5b86e-cb45-4d39-af16-e7d0aba0ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-66c94cd7-838e-4c1d-a573-299ced724acd tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (2abf51cc-ceb8-4be7-b002-f35226d5a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cea52c8-44c3-4918-9662-2cbdb2e3199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cea52c8-44c3-4918-9662-2cbdb2e3199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-457702067',display_name='tempest-VolumesGetTest-Volume-593589935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f1e203-4c95-48d1-95bc-2e24301fd788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:59Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ffc765-44ad-4dba-bd55-2675152f2e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ffc765-44ad-4dba-bd55-2675152f2e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6c02e0-cf3e-47c7-b001-45db8289c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6c02e0-cf3e-47c7-b001-45db8289c37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f1e203-4c95-48d1-95bc-2e24301fd788', 'volume_name': 'volume-33f1e203-4c95-48d1-95bc-2e24301fd788', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4e157f-1d21-4b2d-8c2c-2c63c86450c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea4e157f-1d21-4b2d-8c2c-2c63c86450c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e102a8-94e5-4d67-8b90-53430eb87b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:40:59 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Volume 33f1e203-4c95-48d1-95bc-2e24301fd788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f1e203-4c95-48d1-95bc-2e24301fd788', 'volume_size': 1} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:40:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-457702067',display_name='tempest-VolumesGetTest-Volume-593589935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f1e203-4c95-48d1-95bc-2e24301fd788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:40:59Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Creating volume 33f1e203-4c95-48d1-95bc-2e24301fd788 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:40:59 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:40:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:40:59 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 1073741824 Jul 30 16:40:59 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:00 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 1073741824" returned: 0 in 0.758s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:00 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 Jul 30 16:41:00 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:01 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788" returned: 0 in 0.365s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e102a8-94e5-4d67-8b90-53430eb87b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f1e203-4c95-48d1-95bc-2e24301fd788', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d1c0db-991e-4b20-8189-eb562714fed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:01 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Volume volume-33f1e203-4c95-48d1-95bc-2e24301fd788 (33f1e203-4c95-48d1-95bc-2e24301fd788): created successfully Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d1c0db-991e-4b20-8189-eb562714fed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (2abf51cc-ceb8-4be7-b002-f35226d5a44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3824dc7d-0dc4-40df-8053-9466adc91bd0 tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-33f1e203-4c95-48d1-95bc-2e24301fd788-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Lock "cinder-33f1e203-4c95-48d1-95bc-2e24301fd788-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-33f1e203-4c95-48d1-95bc-2e24301fd788" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-33f1e203-4c95-48d1-95bc-2e24301fd788" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3267aa85-c22e-44c6-b572-2df644e8ec6b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:02 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 Jul 30 16:41:02 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:02 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788" returned: 0 in 0.389s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:02 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788 Jul 30 16:41:02 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:02 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33f1e203-4c95-48d1-95bc-2e24301fd788" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-33f1e203-4c95-48d1-95bc-2e24301fd788" released by "delete_volume" :: held 0.708s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Created reservations ['102e3b50-1233-4b82-ba81-08ec8d2cad36', 'bdf81568-23d2-4bac-8439-2053b04782cb', '1dd0d7f9-6c37-414f-bc7f-5f09746d0434', '8d138544-7eeb-4fd8-b4b7-ae42f9c77e00'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:02 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:02 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:03 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.266s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d7461f7-b604-4f12-9e04-2df52de9221b tempest-VolumesGetTest-1060828599 None] Lock "cinder-33f1e203-4c95-48d1-95bc-2e24301fd788-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-e20c1a01-284f-4a2b-8a6a-deee41661fa2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Lock "cinder-e20c1a01-284f-4a2b-8a6a-deee41661fa2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-e20c1a01-284f-4a2b-8a6a-deee41661fa2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-e20c1a01-284f-4a2b-8a6a-deee41661fa2" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a4e504-ea15-47f4-8cf4-f8c71268f355]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:03 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 Jul 30 16:41:03 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:03 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2" returned: 0 in 0.499s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:03 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2 Jul 30 16:41:03 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:04 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e20c1a01-284f-4a2b-8a6a-deee41661fa2" returned: 0 in 0.319s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-e20c1a01-284f-4a2b-8a6a-deee41661fa2" released by "delete_volume" :: held 0.876s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Created reservations ['367b959b-aef8-4d8c-b6b0-e5bdd7caa3bb', '5dd161f4-b6d2-4af3-80cb-ea4cef7a8b6a', '5e41f134-1337-40c5-836f-c7693cac3e71', '12a3b87e-3706-4dd6-892d-f10a6cdfc435'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:04 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:04 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-00e045e2-72b2-472f-9527-feb484d351a3-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Lock "cinder-00e045e2-72b2-472f-9527-feb484d351a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-00e045e2-72b2-472f-9527-feb484d351a3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-00e045e2-72b2-472f-9527-feb484d351a3" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:04 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.328s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[47928789-1d79-43f2-9703-cd20f1a3fe98]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4fe6fba-5071-46e5-b394-8e3e797b3da4 tempest-VolumesGetTest-1060828599 None] Lock "cinder-e20c1a01-284f-4a2b-8a6a-deee41661fa2-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:04 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 Jul 30 16:41:04 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:04 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3" returned: 0 in 0.371s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:04 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3 Jul 30 16:41:04 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:05 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-00e045e2-72b2-472f-9527-feb484d351a3" returned: 0 in 0.282s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-00e045e2-72b2-472f-9527-feb484d351a3" released by "delete_volume" :: held 0.733s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Created reservations ['5d92ac51-100e-4af0-a1aa-4fdf2c1fea22', '7dd0d6de-0843-4769-9081-2870c2f3900d', 'ed5a8bd8-5b5f-41d5-b415-0c6e463f8b54', 'bd6fccbe-c31d-4a80-a1a6-86a2b7a00639'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:05 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:05 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:05 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.295s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:05 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:41:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ad61263d-5205-46a6-8ed9-7a776fa44509 tempest-VolumesGetTest-1060828599 None] Lock "cinder-00e045e2-72b2-472f-9527-feb484d351a3-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (7684324e-edc8-4d1e-a303-89877dd84eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11808ea-bad8-4698-9a99-5eaf7b86dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11808ea-bad8-4698-9a99-5eaf7b86dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552274520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:06Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ff32a6-68cb-42b2-86fc-59ffdc64c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ff32a6-68cb-42b2-86fc-59ffdc64c79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d0ff78-375a-4544-913b-887eefb0b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d0ff78-375a-4544-913b-887eefb0b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63', 'volume_name': 'volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fc722c-c720-4192-ba3b-d88ec800013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fc722c-c720-4192-ba3b-d88ec800013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74df1f03-3b27-4ede-a831-da27b2d43e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Volume 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:41:06 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Trying to clone 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 from image e99749b8-1b47-4194-9cb3-562081ac77f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:41:07 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a0d04c-bc9d-490e-ba84-238d80cce502]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:07 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD Jul 30 16:41:07 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:07 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 is fetched for user 3328ad83b1644f8c8483b0020dbc900f. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[00954132-0b66-4d1e-be90-3ded215017d8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:08 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD Jul 30 16:41:08 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:08 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-552274520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:06Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Creating volume 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:08 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:08 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 1073741824 Jul 30 16:41:08 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:08 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 1073741824" returned: 0 in 0.497s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:08 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 Jul 30 16:41:08 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:09 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" returned: 0 in 0.257s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Attempting download of e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced1aaba-1a23-413c-bc5c-4af144a9dd7b]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:09 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls Jul 30 16:41:09 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:09 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:09 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls Jul 30 16:41:09 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:09 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls" returned: 1 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_lihtslls' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34f7b44-ab74-4dc5-84aa-128f7d1c4cfd]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:10 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD Jul 30 16:41:10 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:10 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:10 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] e99749b8-1b47-4194-9cb3-562081ac77f1 was qcow2, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:41:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:10 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 Jul 30 16:41:10 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:12 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" returned: 0 in 2.171s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_z6podbx1devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:41:12 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Converted 112.00 MB image at 51.56 MB/s Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:12 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 1G Jul 30 16:41:12 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:12 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 1G" returned: 0 in 0.413s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Downloaded image e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 for user 3328ad83b1644f8c8483b0020dbc900f is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Marking volume 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Copying metadata from image e99749b8-1b47-4194-9cb3-562081ac77f1 to 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:41:12 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Creating volume glance metadata for volume 7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 backed by image e99749b8-1b47-4194-9cb3-562081ac77f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:41:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74df1f03-3b27-4ede-a831-da27b2d43e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba90ec13-7b51-4076-9ddc-ff61b62dbd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:13 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Volume volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 (7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63): created successfully Jul 30 16:41:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba90ec13-7b51-4076-9ddc-ff61b62dbd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (7684324e-edc8-4d1e-a303-89877dd84eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:13 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b759a19b-13b1-4419-a646-cc11ddebe48a tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (e93dec74-e5e9-4b27-a707-b5fcaeba8d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723e9633-eaa5-4f82-9abc-5a131da82b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723e9633-eaa5-4f82-9abc-5a131da82b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-735253177',display_name='tempest-VolumesGetTest-Volume-858443360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d970a36f-32e7-45c9-96a1-1261b5719b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:15Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34618dc4-4421-4fed-b9e9-10dea73b69d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34618dc4-4421-4fed-b9e9-10dea73b69d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feda3bbe-9a31-4971-a4ba-cde98fcb0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feda3bbe-9a31-4971-a4ba-cde98fcb0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd970a36f-32e7-45c9-96a1-1261b5719b61', 'volume_name': 'volume-d970a36f-32e7-45c9-96a1-1261b5719b61', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e64d28-0da4-4c1f-b490-c427e5f9798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e64d28-0da4-4c1f-b490-c427e5f9798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459ff096-ab30-4895-9fb7-b15f2d3f889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Volume d970a36f-32e7-45c9-96a1-1261b5719b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d970a36f-32e7-45c9-96a1-1261b5719b61', 'volume_size': 1} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-735253177',display_name='tempest-VolumesGetTest-Volume-858443360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d970a36f-32e7-45c9-96a1-1261b5719b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e2146542e4400186bfb2c5dac1edac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:15Z,use_quota=True,user_id='3328ad83b1644f8c8483b0020dbc900f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Creating volume d970a36f-32e7-45c9-96a1-1261b5719b61 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:14 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:41:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:14 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 1073741824 Jul 30 16:41:14 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:15 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 1073741824" returned: 0 in 0.573s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:15 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 Jul 30 16:41:15 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:15 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61" returned: 0 in 0.271s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459ff096-ab30-4895-9fb7-b15f2d3f889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d970a36f-32e7-45c9-96a1-1261b5719b61', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ca95b0-44c8-455c-a522-fb70a62a11e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:15 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Volume volume-d970a36f-32e7-45c9-96a1-1261b5719b61 (d970a36f-32e7-45c9-96a1-1261b5719b61): created successfully Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ca95b0-44c8-455c-a522-fb70a62a11e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Flow 'volume_create_manager' (e93dec74-e5e9-4b27-a707-b5fcaeba8d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-58382d23-61d7-490f-a9c1-63ce54053487 tempest-VolumesGetTest-1060828599 None] Created volume successfully. Jul 30 16:41:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-d970a36f-32e7-45c9-96a1-1261b5719b61-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Lock "cinder-d970a36f-32e7-45c9-96a1-1261b5719b61-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-d970a36f-32e7-45c9-96a1-1261b5719b61" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-d970a36f-32e7-45c9-96a1-1261b5719b61" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d234e89c-3ce7-4236-93b7-2235eeab70ce]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:17 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 Jul 30 16:41:17 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:17 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61" returned: 0 in 0.433s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:17 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61 Jul 30 16:41:17 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:17 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d970a36f-32e7-45c9-96a1-1261b5719b61" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-d970a36f-32e7-45c9-96a1-1261b5719b61" released by "delete_volume" :: held 0.750s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Created reservations ['8437dc04-ba8a-4742-ac24-7bbd1358dcb0', 'ffdaa91e-b9f8-46cc-aa2f-42de34545703', 'abd8ade2-e80d-448f-8707-635e963696ce', '4e9f3d9f-7f00-4bdc-96eb-0653022d88c1'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:17 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:17 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:18 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.317s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Lock "cinder-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d4b4060-8528-411d-abaf-28c0c26ae695 tempest-VolumesGetTest-1060828599 None] Lock "cinder-d970a36f-32e7-45c9-96a1-1261b5719b61-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Acquiring lock "cinder-quobyte-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc20e9-5068-4ceb-9fd0-acd2624ff884]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:18 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 Jul 30 16:41:18 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:18 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" returned: 0 in 0.398s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:18 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63 Jul 30 16:41:18 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Flow 'volume_create_manager' (3cf4a2d3-4023-486e-912f-b4bfe4e24080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56240b0d-2e45-40c0-830f-7302482580a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:19 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56240b0d-2e45-40c0-830f-7302482580a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-486148815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cabccc-6d50-4888-87e0-ea8c20c6a49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366e352e903d4ba0b1c321393d4cc5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:19Z,use_quota=True,user_id='18927a9d57c94375a4dcfffa82aebc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98b223c-3785-4311-8769-6336ee2d00a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98b223c-3785-4311-8769-6336ee2d00a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b57d0de-e85d-4ec4-a52b-bacbdc476211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Lock "cinder-quobyte-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63" released by "delete_volume" :: held 0.740s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Created reservations ['c0f29c3d-ce2f-41f9-b47b-93fcf3d00204', '4e1b0755-0753-43ee-a782-ace0465d0880', '021ad03f-7804-4e02-b0c5-9b8b13e74809', 'fbeab24e-f7a3-49da-b180-4c7a529af0fa'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:19 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:19 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b57d0de-e85d-4ec4-a52b-bacbdc476211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7cabccc-6d50-4888-87e0-ea8c20c6a49e', 'volume_name': 'volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab19dcde-f6db-41ee-9e75-778947eb09da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab19dcde-f6db-41ee-9e75-778947eb09da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf087d7-c27a-49f7-899b-40948af6e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:19 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Volume d7cabccc-6d50-4888-87e0-ea8c20c6a49e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Trying to clone d7cabccc-6d50-4888-87e0-ea8c20c6a49e from image e99749b8-1b47-4194-9cb3-562081ac77f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:41:19 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:19 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Deleted volume successfully. Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4d73f30e-a71d-4a27-9bbc-2d338df3a9bc tempest-VolumesGetTest-1060828599 None] Lock "cinder-7ba6a3e1-0fa6-4b09-b62d-bdec18e17e63-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:41:19 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[138cb009-b560-4528-8a57-ee01645bf9d3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:19 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD Jul 30 16:41:19 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:20 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 is fetched for user 18927a9d57c94375a4dcfffa82aebc9f. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a79778e-54e7-4b77-b144-7b25a2bc205f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:20 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD Jul 30 16:41:20 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:20 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-486148815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7cabccc-6d50-4888-87e0-ea8c20c6a49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366e352e903d4ba0b1c321393d4cc5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:19Z,use_quota=True,user_id='18927a9d57c94375a4dcfffa82aebc9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Creating volume d7cabccc-6d50-4888-87e0-ea8c20c6a49e {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:20 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:41:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:20 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e 1073741824 Jul 30 16:41:20 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:21 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e 1073741824" returned: 0 in 0.474s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:21 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e Jul 30 16:41:21 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:21 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Attempting download of e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume d7cabccc-6d50-4888-87e0-ea8c20c6a49e. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[59193f99-83f0-472e-81b2-027e6f50a03a]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:21 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb Jul 30 16:41:21 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:21 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb" returned: 0 in 0.374s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:21 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb Jul 30 16:41:21 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:22 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb" returned: 1 in 0.401s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_1md1vzyb' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b134cb1-2fdd-4930-9288-6c6f9477bcd3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:22 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD Jul 30 16:41:22 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:22 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] e99749b8-1b47-4194-9cb3-562081ac77f1 was qcow2, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:41:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:22 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e Jul 30 16:41:22 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-ec5c1119-f3ca-47ff-b4f9-8a11fa7c5a9b req-38a2c50c-7208-40bf-abb3-91e9b4ba5f46 tempest-AttachVolumeTestJSON-954158415 None] Terminate volume connection completed successfully. Jul 30 16:41:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-ec5c1119-f3ca-47ff-b4f9-8a11fa7c5a9b req-38a2c50c-7208-40bf-abb3-91e9b4ba5f46 tempest-AttachVolumeTestJSON-954158415 None] Deleting attachment aa50580d-7e27-4df6-87e0-d2fb7876daa0. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:41:25 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" returned: 0 in 2.940s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:25 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_o9srn2ikdevstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:41:25 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Converted 112.00 MB image at 38.07 MB/s Jul 30 16:41:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:25 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e 1G Jul 30 16:41:25 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:26 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e 1G" returned: 0 in 0.360s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Downloaded image e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume d7cabccc-6d50-4888-87e0-ea8c20c6a49e successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 for user 18927a9d57c94375a4dcfffa82aebc9f is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Marking volume d7cabccc-6d50-4888-87e0-ea8c20c6a49e as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Copying metadata from image e99749b8-1b47-4194-9cb3-562081ac77f1 to d7cabccc-6d50-4888-87e0-ea8c20c6a49e. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Creating volume glance metadata for volume d7cabccc-6d50-4888-87e0-ea8c20c6a49e backed by image e99749b8-1b47-4194-9cb3-562081ac77f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf087d7-c27a-49f7-899b-40948af6e212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3988478-d163-4320-bcd9-65ec82de6d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:26 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Volume volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e (d7cabccc-6d50-4888-87e0-ea8c20c6a49e): created successfully Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3988478-d163-4320-bcd9-65ec82de6d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Flow 'volume_create_manager' (3cf4a2d3-4023-486e-912f-b4bfe4e24080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ac41ffba-26a0-4df7-b855-d5a3a94ffc03 tempest-TestShelveInstance-132142685 None] Created volume successfully. Jul 30 16:41:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Acquiring lock "cinder-6e28082e-8204-4670-8ee5-b274146ae322-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "cinder-6e28082e-8204-4670-8ee5-b274146ae322-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Acquiring lock "cinder-quobyte-6e28082e-8204-4670-8ee5-b274146ae322" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:41:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "cinder-quobyte-6e28082e-8204-4670-8ee5-b274146ae322" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:41:28 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc3a277-aeaf-4117-9749-ccc5f6889e34]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:41:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:28 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 Jul 30 16:41:28 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:28 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322" returned: 0 in 0.450s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:28 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322 Jul 30 16:41:28 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:29 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6e28082e-8204-4670-8ee5-b274146ae322" returned: 0 in 0.533s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "cinder-quobyte-6e28082e-8204-4670-8ee5-b274146ae322" released by "delete_volume" :: held 1.074s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Created reservations ['72021ceb-4224-4620-96d3-4dd77e5ee57f', 'f20c7c60-f241-4c62-aa1a-c90f0547da69', '1276b282-19d4-49bf-a2c1-63de91fc4ba3', 'e961de51-cd80-46e6-aabe-548714b22e1f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:29 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:29 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:30 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.650s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:30 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:30 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Deleted volume successfully. Jul 30 16:41:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8c36709-3309-45ad-aa86-db3d48f64a17 tempest-AttachVolumeShelveTestJSON-424503945 None] Lock "cinder-6e28082e-8204-4670-8ee5-b274146ae322-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:41:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-123a4c16-5576-42eb-bd64-be6794c239bc req-14a1dc4b-1e2e-47fa-9fec-1ab1850f840d tempest-TestShelveInstance-132142685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-123a4c16-5576-42eb-bd64-be6794c239bc req-14a1dc4b-1e2e-47fa-9fec-1ab1850f840d tempest-TestShelveInstance-132142685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-123a4c16-5576-42eb-bd64-be6794c239bc req-14a1dc4b-1e2e-47fa-9fec-1ab1850f840d tempest-TestShelveInstance-132142685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-123a4c16-5576-42eb-bd64-be6794c239bc req-14a1dc4b-1e2e-47fa-9fec-1ab1850f840d tempest-TestShelveInstance-132142685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c5bb39a-e52d-46a4-ae35-4a1bead780cc', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:41:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-123a4c16-5576-42eb-bd64-be6794c239bc req-14a1dc4b-1e2e-47fa-9fec-1ab1850f840d tempest-TestShelveInstance-132142685 None] attachment_update completed successfully. Jul 30 16:41:42 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=60,cinder:UPDATE=66,cinder:DELETE=5,cinder:INSERT=27 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:41:46 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=71,cinder:INSERT=28,cinder:DELETE=6,cinder:SELECT=64 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:54 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:41:54 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:55 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.602s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Flow 'volume_create_manager' (ea95d784-93e5-42b3-8142-e761a4f21e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f96638-ad84-4e54-bd77-2f4769ab2d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f96638-ad84-4e54-bd77-2f4769ab2d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1314030794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a157c8c0-a68f-46eb-98db-be1898dcee7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71e0cfb3f2941ac8da8718d39f2278c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:55Z,use_quota=True,user_id='ee61377041a542bd9b67e0a47a5a5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f0d4e-3e62-40d8-8cd8-9726f69ddb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f0d4e-3e62-40d8-8cd8-9726f69ddb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5c212a-9722-476c-a9a1-0b01a57d4dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5c212a-9722-476c-a9a1-0b01a57d4dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a157c8c0-a68f-46eb-98db-be1898dcee7e', 'volume_name': 'volume-a157c8c0-a68f-46eb-98db-be1898dcee7e', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c35b45-b290-45ad-8b1c-48e8769ec798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c35b45-b290-45ad-8b1c-48e8769ec798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4ab08f-046c-4b66-bd39-d47b40192fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:55 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Volume a157c8c0-a68f-46eb-98db-be1898dcee7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a157c8c0-a68f-46eb-98db-be1898dcee7e', 'volume_size': 1} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1314030794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a157c8c0-a68f-46eb-98db-be1898dcee7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71e0cfb3f2941ac8da8718d39f2278c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:55Z,use_quota=True,user_id='ee61377041a542bd9b67e0a47a5a5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Creating volume a157c8c0-a68f-46eb-98db-be1898dcee7e {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:55 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:41:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:55 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e 1073741824 Jul 30 16:41:55 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Flow 'volume_create_manager' (f7d628c0-6490-40d6-affd-c13378c38317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e467a326-1ab0-445d-949e-a73ae94225cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:56 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e467a326-1ab0-445d-949e-a73ae94225cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2014734356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c5a284-acd2-4e89-8c01-e168f0de324f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71e0cfb3f2941ac8da8718d39f2278c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:56Z,use_quota=True,user_id='ee61377041a542bd9b67e0a47a5a5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f6a821-af35-405e-a3c0-18550cb1c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f6a821-af35-405e-a3c0-18550cb1c392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde26d37-edef-43a1-87a7-678303ff71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde26d37-edef-43a1-87a7-678303ff71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c5a284-acd2-4e89-8c01-e168f0de324f', 'volume_name': 'volume-e6c5a284-acd2-4e89-8c01-e168f0de324f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e27edf-da44-40d3-bd0f-95f42a632620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e27edf-da44-40d3-bd0f-95f42a632620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4f4caf-524e-4dae-a198-1c6101c0f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:56 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Volume e6c5a284-acd2-4e89-8c01-e168f0de324f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c5a284-acd2-4e89-8c01-e168f0de324f', 'volume_size': 1} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e 1073741824" returned: 0 in 0.985s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:56 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e Jul 30 16:41:56 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:57 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e" returned: 0 in 0.348s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2014734356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c5a284-acd2-4e89-8c01-e168f0de324f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a71e0cfb3f2941ac8da8718d39f2278c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:41:56Z,use_quota=True,user_id='ee61377041a542bd9b67e0a47a5a5f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Creating volume e6c5a284-acd2-4e89-8c01-e168f0de324f {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:41:57 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b4ab08f-046c-4b66-bd39-d47b40192fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a157c8c0-a68f-46eb-98db-be1898dcee7e', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa0ab3b-2b32-44a6-a5cb-0cbd074b9fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:57 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f 1073741824 Jul 30 16:41:57 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:57 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Volume volume-a157c8c0-a68f-46eb-98db-be1898dcee7e (a157c8c0-a68f-46eb-98db-be1898dcee7e): created successfully Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa0ab3b-2b32-44a6-a5cb-0cbd074b9fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Flow 'volume_create_manager' (ea95d784-93e5-42b3-8142-e761a4f21e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f7c24664-a2e8-44c7-92a7-911446a645df tempest-TestServerVolumeAttachmentScenario-1637365877 None] Created volume successfully. Jul 30 16:41:57 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f 1073741824" returned: 0 in 0.835s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:41:58 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f Jul 30 16:41:58 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:41:58 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4f4caf-524e-4dae-a198-1c6101c0f63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c5a284-acd2-4e89-8c01-e168f0de324f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f19e2d-84fb-4e60-b24a-3aecb73c51f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:41:58 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Volume volume-e6c5a284-acd2-4e89-8c01-e168f0de324f (e6c5a284-acd2-4e89-8c01-e168f0de324f): created successfully Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f19e2d-84fb-4e60-b24a-3aecb73c51f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:41:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Flow 'volume_create_manager' (f7d628c0-6490-40d6-affd-c13378c38317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:41:58 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-987f3296-006e-4c1b-93f9-3e7262b04ab7 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Created volume successfully. Jul 30 16:42:08 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=3,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:08 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-0d3332ba-baac-4ed1-9add-120f9f6e9d1f req-c3a327bc-579a-4817-a52a-8e7e09fa8846 tempest-TestShelveInstance-132142685 None] Terminate volume connection completed successfully. Jul 30 16:42:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-0d3332ba-baac-4ed1-9add-120f9f6e9d1f req-c3a327bc-579a-4817-a52a-8e7e09fa8846 tempest-TestShelveInstance-132142685 None] Deleting attachment 3c5bb39a-e52d-46a4-ae35-4a1bead780cc. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:42:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-81256610-dd44-48b3-82f2-55f4c0b200c0 req-1fe13cf6-8c30-4653-8ada-aed3e0e0902b tempest-TestShelveInstance-132142685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-81256610-dd44-48b3-82f2-55f4c0b200c0 req-1fe13cf6-8c30-4653-8ada-aed3e0e0902b tempest-TestShelveInstance-132142685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-81256610-dd44-48b3-82f2-55f4c0b200c0 req-1fe13cf6-8c30-4653-8ada-aed3e0e0902b tempest-TestShelveInstance-132142685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-81256610-dd44-48b3-82f2-55f4c0b200c0 req-1fe13cf6-8c30-4653-8ada-aed3e0e0902b tempest-TestShelveInstance-132142685 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8117b10d-6f1e-4017-a610-d7a72465c0d1', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:42:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-81256610-dd44-48b3-82f2-55f4c0b200c0 req-1fe13cf6-8c30-4653-8ada-aed3e0e0902b tempest-TestShelveInstance-132142685 None] attachment_update completed successfully. Jul 30 16:42:37 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:37 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:42:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-7bb24631-6e46-4e95-ba59-29217fcda482 req-16a671cb-4e7f-4979-b0ca-f8855d075051 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-7bb24631-6e46-4e95-ba59-29217fcda482 req-16a671cb-4e7f-4979-b0ca-f8855d075051 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-7bb24631-6e46-4e95-ba59-29217fcda482 req-16a671cb-4e7f-4979-b0ca-f8855d075051 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-7bb24631-6e46-4e95-ba59-29217fcda482 req-16a671cb-4e7f-4979-b0ca-f8855d075051 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-a157c8c0-a68f-46eb-98db-be1898dcee7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ca3b506-43c2-4a44-aae9-a042e3a12b11', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:42:40 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-7bb24631-6e46-4e95-ba59-29217fcda482 req-16a671cb-4e7f-4979-b0ca-f8855d075051 tempest-TestServerVolumeAttachmentScenario-1637365877 None] attachment_update completed successfully. Jul 30 16:42:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-48895d71-1904-4f43-b97d-c79d59a55676 req-0cdb4968-e762-47ee-9872-b01bbfd99797 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-48895d71-1904-4f43-b97d-c79d59a55676 req-0cdb4968-e762-47ee-9872-b01bbfd99797 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-48895d71-1904-4f43-b97d-c79d59a55676 req-0cdb4968-e762-47ee-9872-b01bbfd99797 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-48895d71-1904-4f43-b97d-c79d59a55676 req-0cdb4968-e762-47ee-9872-b01bbfd99797 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-e6c5a284-acd2-4e89-8c01-e168f0de324f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c95c15e8-bd24-4dc7-a63a-0c9091aed924', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:42:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-48895d71-1904-4f43-b97d-c79d59a55676 req-0cdb4968-e762-47ee-9872-b01bbfd99797 tempest-TestServerVolumeAttachmentScenario-1637365877 None] attachment_update completed successfully. Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Flow 'volume_create_manager' (6839e0d9-fe09-42d5-9f93-d60de43a01ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bcd030-ff39-4423-a5be-f532cbd0ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bcd030-ff39-4423-a5be-f532cbd0ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1701313324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04faf451-3471-4697-9444-a8536db5f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e16a383b74b1b92054169e202922e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:47Z,use_quota=True,user_id='7011e23c8c2f4b498f63910b4c2b77f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00700ec8-5ca6-4919-ad89-35420ba28bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00700ec8-5ca6-4919-ad89-35420ba28bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67469e1d-c3ec-49d3-8fef-e8218df1580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67469e1d-c3ec-49d3-8fef-e8218df1580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04faf451-3471-4697-9444-a8536db5f17a', 'volume_name': 'volume-04faf451-3471-4697-9444-a8536db5f17a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931301be-b327-44bf-8ff8-2bb3823b158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931301be-b327-44bf-8ff8-2bb3823b158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d7ad4a-79b1-4d54-9f61-70a21c9314fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Volume 04faf451-3471-4697-9444-a8536db5f17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04faf451-3471-4697-9444-a8536db5f17a', 'volume_size': 1} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1701313324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04faf451-3471-4697-9444-a8536db5f17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e16a383b74b1b92054169e202922e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:47Z,use_quota=True,user_id='7011e23c8c2f4b498f63910b4c2b77f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Creating volume 04faf451-3471-4697-9444-a8536db5f17a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:42:47 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:47 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a 1073741824 Jul 30 16:42:47 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:47 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a 1073741824" returned: 0 in 0.511s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:47 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a Jul 30 16:42:47 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:48 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a" returned: 0 in 0.337s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d7ad4a-79b1-4d54-9f61-70a21c9314fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04faf451-3471-4697-9444-a8536db5f17a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcad0028-25ef-48e0-bde8-a24f7adc2b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:48 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Volume volume-04faf451-3471-4697-9444-a8536db5f17a (04faf451-3471-4697-9444-a8536db5f17a): created successfully Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcad0028-25ef-48e0-bde8-a24f7adc2b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Flow 'volume_create_manager' (6839e0d9-fe09-42d5-9f93-d60de43a01ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f270bf8f-5c52-47f8-b7c1-21da3f460265 tempest-AttachVolumeTestJSON-954158415 None] Created volume successfully. Jul 30 16:42:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-d446f28a-4460-456f-9381-45a8e1927535 req-f57c97ef-9ea2-4954-a3a7-e53ab1fa5b05 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Terminate volume connection completed successfully. Jul 30 16:42:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-d446f28a-4460-456f-9381-45a8e1927535 req-f57c97ef-9ea2-4954-a3a7-e53ab1fa5b05 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Deleting attachment c95c15e8-bd24-4dc7-a63a-0c9091aed924. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-87bc208e-5b1f-45f4-9784-34c9cf9fa717 req-6dbf6d20-ee83-4b43-bea9-c0c85ae2251d tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-87bc208e-5b1f-45f4-9784-34c9cf9fa717 req-6dbf6d20-ee83-4b43-bea9-c0c85ae2251d tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-87bc208e-5b1f-45f4-9784-34c9cf9fa717 req-6dbf6d20-ee83-4b43-bea9-c0c85ae2251d tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-87bc208e-5b1f-45f4-9784-34c9cf9fa717 req-6dbf6d20-ee83-4b43-bea9-c0c85ae2251d tempest-AttachVolumeTestJSON-954158415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-04faf451-3471-4697-9444-a8536db5f17a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1fbc474-eafe-43ff-8622-14a84e4a1695', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:42:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-4c33974c-8e9e-4847-bb92-55f9dbfa67c2 req-aafa9352-50cb-44b9-9193-d180ef7ea3f5 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Terminate volume connection completed successfully. Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-4c33974c-8e9e-4847-bb92-55f9dbfa67c2 req-aafa9352-50cb-44b9-9193-d180ef7ea3f5 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Deleting attachment 7ca3b506-43c2-4a44-aae9-a042e3a12b11. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:42:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-87bc208e-5b1f-45f4-9784-34c9cf9fa717 req-6dbf6d20-ee83-4b43-bea9-c0c85ae2251d tempest-AttachVolumeTestJSON-954158415 None] attachment_update completed successfully. Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Flow 'volume_create_manager' (98a5323e-6ff4-49b9-8ec5-e74b141f4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48642c25-26d3-4a21-995e-56a16031778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48642c25-26d3-4a21-995e-56a16031778a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1254222064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf9910d-3db4-40c3-872b-2e7cd1dbe925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115f268796f744bc87d7cdf418bf283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:51Z,use_quota=True,user_id='625642d733a344d898e49fb5214b9af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50329382-00cf-4543-9181-3ec993300872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50329382-00cf-4543-9181-3ec993300872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d48285-5667-4423-86e5-96f2c869e38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d48285-5667-4423-86e5-96f2c869e38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf9910d-3db4-40c3-872b-2e7cd1dbe925', 'volume_name': 'volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c346fe-8307-4d81-aa95-cf30078da9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c346fe-8307-4d81-aa95-cf30078da9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73323178-1023-4072-a7f0-d0033176ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:50 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Volume faf9910d-3db4-40c3-872b-2e7cd1dbe925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925', 'volume_size': 1} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1254222064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf9910d-3db4-40c3-872b-2e7cd1dbe925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115f268796f744bc87d7cdf418bf283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:51Z,use_quota=True,user_id='625642d733a344d898e49fb5214b9af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Creating volume faf9910d-3db4-40c3-872b-2e7cd1dbe925 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:42:50 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:42:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:50 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 1073741824 Jul 30 16:42:50 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:51 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 1073741824" returned: 0 in 0.630s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:51 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 Jul 30 16:42:51 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:51 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925" returned: 0 in 0.362s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73323178-1023-4072-a7f0-d0033176ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e40ccdc-a6ef-473b-91f0-e5030cc0dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Volume volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 (faf9910d-3db4-40c3-872b-2e7cd1dbe925): created successfully Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e40ccdc-a6ef-473b-91f0-e5030cc0dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Flow 'volume_create_manager' (98a5323e-6ff4-49b9-8ec5-e74b141f4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8ff2fa9c-0b89-41bb-b543-4b86718ae707 tempest-AttachVolumeNegativeTest-253340097 None] Created volume successfully. Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Flow 'volume_create_manager' (2af1e66f-31ee-4c8d-8f36-16bcd7dd7f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7eb1ad-9efa-454f-87c6-0646a3a2c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7eb1ad-9efa-454f-87c6-0646a3a2c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-713930940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a624554-32fb-4a24-a2d8-426572305125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e16a383b74b1b92054169e202922e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:53Z,use_quota=True,user_id='7011e23c8c2f4b498f63910b4c2b77f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a68221-53b4-4163-80e1-5d071fd96271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25a68221-53b4-4163-80e1-5d071fd96271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9088dcc0-1c3d-4cd0-b407-4c35f198da5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9088dcc0-1c3d-4cd0-b407-4c35f198da5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a624554-32fb-4a24-a2d8-426572305125', 'volume_name': 'volume-7a624554-32fb-4a24-a2d8-426572305125', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34f0584-a31d-4a95-8d8b-11225af2e691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34f0584-a31d-4a95-8d8b-11225af2e691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7005d5e-210a-4293-af59-2c67cb703e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Volume 7a624554-32fb-4a24-a2d8-426572305125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a624554-32fb-4a24-a2d8-426572305125', 'volume_size': 1} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-713930940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a624554-32fb-4a24-a2d8-426572305125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264e16a383b74b1b92054169e202922e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:42:53Z,use_quota=True,user_id='7011e23c8c2f4b498f63910b4c2b77f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Creating volume 7a624554-32fb-4a24-a2d8-426572305125 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:42:53 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:53 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 1073741824 Jul 30 16:42:53 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-5671a722-77df-4ab5-886b-73d1e53b9cf9 req-d0af62bc-a245-4ad3-8fb7-27e8e52ed4b4 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:53 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 1073741824" returned: 0 in 0.497s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:53 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 Jul 30 16:42:53 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:54 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125" returned: 0 in 0.267s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-5671a722-77df-4ab5-886b-73d1e53b9cf9 req-d0af62bc-a245-4ad3-8fb7-27e8e52ed4b4 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.636s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7005d5e-210a-4293-af59-2c67cb703e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a624554-32fb-4a24-a2d8-426572305125', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027f4ee5-fae5-48e0-aece-fa0d6ddde995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-5671a722-77df-4ab5-886b-73d1e53b9cf9 req-d0af62bc-a245-4ad3-8fb7-27e8e52ed4b4 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Volume volume-7a624554-32fb-4a24-a2d8-426572305125 (7a624554-32fb-4a24-a2d8-426572305125): created successfully Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027f4ee5-fae5-48e0-aece-fa0d6ddde995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Flow 'volume_create_manager' (2af1e66f-31ee-4c8d-8f36-16bcd7dd7f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:42:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a4fe3d09-6f9f-41e2-86e6-d0ba0b6063a4 tempest-AttachVolumeTestJSON-954158415 None] Created volume successfully. Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-5671a722-77df-4ab5-886b-73d1e53b9cf9 req-d0af62bc-a245-4ad3-8fb7-27e8e52ed4b4 tempest-AttachVolumeNegativeTest-253340097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9e24ea2-25ff-4b0e-b48d-d53f4c7e23b1', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:42:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-5671a722-77df-4ab5-886b-73d1e53b9cf9 req-d0af62bc-a245-4ad3-8fb7-27e8e52ed4b4 tempest-AttachVolumeNegativeTest-253340097 None] attachment_update completed successfully. Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:54 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:42:54 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:54 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:42:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "cinder-e6c5a284-acd2-4e89-8c01-e168f0de324f-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-e6c5a284-acd2-4e89-8c01-e168f0de324f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "cinder-quobyte-e6c5a284-acd2-4e89-8c01-e168f0de324f" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-quobyte-e6c5a284-acd2-4e89-8c01-e168f0de324f" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab24e963-5ead-4e07-aad3-7583cfe31eb5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:55 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f Jul 30 16:42:55 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:55 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f" returned: 0 in 0.451s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:55 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f Jul 30 16:42:55 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-be06d76a-db48-4fb1-9268-bc3a66e15ccb req-f3aa7614-2290-4fa4-b522-317aaa1763a6 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-be06d76a-db48-4fb1-9268-bc3a66e15ccb req-f3aa7614-2290-4fa4-b522-317aaa1763a6 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-be06d76a-db48-4fb1-9268-bc3a66e15ccb req-f3aa7614-2290-4fa4-b522-317aaa1763a6 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-be06d76a-db48-4fb1-9268-bc3a66e15ccb req-f3aa7614-2290-4fa4-b522-317aaa1763a6 tempest-AttachVolumeTestJSON-954158415 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-7a624554-32fb-4a24-a2d8-426572305125', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12e7f2d3-4633-4b10-867c-0eec41562be6', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:42:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-be06d76a-db48-4fb1-9268-bc3a66e15ccb req-f3aa7614-2290-4fa4-b522-317aaa1763a6 tempest-AttachVolumeTestJSON-954158415 None] attachment_update completed successfully. Jul 30 16:42:56 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e6c5a284-acd2-4e89-8c01-e168f0de324f" returned: 0 in 0.290s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-quobyte-e6c5a284-acd2-4e89-8c01-e168f0de324f" released by "delete_volume" :: held 0.802s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Created reservations ['e1e9d9a4-d8e1-42f6-90a6-12a1d2f0967c', '39d84bbd-9948-4463-b986-f571f91a33c3', '9ff24dfd-dca9-4d77-a1b1-552b352ee2f5', '1cff3f43-f842-4aaf-b05f-507b5ebf09c3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:56 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:42:56 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:56 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Deleted volume successfully. Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ed7bcfae-c22d-4f4a-b807-c03b47d94f22 tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-e6c5a284-acd2-4e89-8c01-e168f0de324f-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "cinder-a157c8c0-a68f-46eb-98db-be1898dcee7e-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-a157c8c0-a68f-46eb-98db-be1898dcee7e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "cinder-quobyte-a157c8c0-a68f-46eb-98db-be1898dcee7e" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-quobyte-a157c8c0-a68f-46eb-98db-be1898dcee7e" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ecb29-f9b4-4895-bde3-8b9387a681cc]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:57 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e Jul 30 16:42:57 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:57 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e" returned: 0 in 0.425s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:57 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e Jul 30 16:42:57 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:57 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a157c8c0-a68f-46eb-98db-be1898dcee7e" returned: 0 in 0.250s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-quobyte-a157c8c0-a68f-46eb-98db-be1898dcee7e" released by "delete_volume" :: held 0.728s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Created reservations ['e77d2259-6cc6-44d8-a465-03cbbe7d5aa2', 'b08feab1-ee5b-42ac-84a3-1cdccbd765b2', '0fde9c22-26e7-4c40-b188-11624c3832dc', '81f0b590-2df2-40cf-8612-cfa6e2503f7a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:42:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:42:57 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:42:57 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:42:58 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 30 16:42:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.422s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:42:58 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:42:58 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Deleted volume successfully. Jul 30 16:42:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-734d6f4e-3763-4a7e-a6d0-a8f0b6017e9c tempest-TestServerVolumeAttachmentScenario-1637365877 None] Lock "cinder-a157c8c0-a68f-46eb-98db-be1898dcee7e-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:42:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-bab2b758-3330-423d-bffd-12e336b009e7 req-fcc4ed05-4c9a-48f5-b80e-4de7ed1d64d3 tempest-AttachVolumeTestJSON-954158415 None] Terminate volume connection completed successfully. Jul 30 16:42:59 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-bab2b758-3330-423d-bffd-12e336b009e7 req-fcc4ed05-4c9a-48f5-b80e-4de7ed1d64d3 tempest-AttachVolumeTestJSON-954158415 None] Deleting attachment c1fbc474-eafe-43ff-8622-14a84e4a1695. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:43:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-f64c9d80-265b-4599-9cef-212792699163 req-97b98700-fe4e-447a-8407-54fa8b7eef2f tempest-AttachVolumeTestJSON-954158415 None] Terminate volume connection completed successfully. Jul 30 16:43:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-f64c9d80-265b-4599-9cef-212792699163 req-97b98700-fe4e-447a-8407-54fa8b7eef2f tempest-AttachVolumeTestJSON-954158415 None] Deleting attachment 12e7f2d3-4633-4b10-867c-0eec41562be6. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:43:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "cinder-7a624554-32fb-4a24-a2d8-426572305125-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-7a624554-32fb-4a24-a2d8-426572305125-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "cinder-quobyte-7a624554-32fb-4a24-a2d8-426572305125" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-quobyte-7a624554-32fb-4a24-a2d8-426572305125" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c4d9d-2ba2-43ca-b2d6-5a780068e4d3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:09 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 Jul 30 16:43:09 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:09 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125" returned: 0 in 0.677s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:09 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125 Jul 30 16:43:09 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:09 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7a624554-32fb-4a24-a2d8-426572305125" returned: 0 in 0.259s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-quobyte-7a624554-32fb-4a24-a2d8-426572305125" released by "delete_volume" :: held 1.004s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Created reservations ['27faedf9-8ed2-48f6-8ae2-8d25dd21313e', '66fe14ce-bf03-4a49-b3f8-20450d20a121', 'edefc546-6ce0-47fb-b0d6-d2bc20913f51', '3f7dcedb-7984-4ec0-846f-e7c28d994e64'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:10 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:43:10 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:10 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.335s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Deleted volume successfully. Jul 30 16:43:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bb8b6ccc-37cd-4ebb-9f08-7be853f814a2 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-7a624554-32fb-4a24-a2d8-426572305125-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "cinder-04faf451-3471-4697-9444-a8536db5f17a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-04faf451-3471-4697-9444-a8536db5f17a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "cinder-quobyte-04faf451-3471-4697-9444-a8536db5f17a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-quobyte-04faf451-3471-4697-9444-a8536db5f17a" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:11 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a606036f-22b0-4538-b649-3be0ba953935]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:11 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a Jul 30 16:43:11 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:12 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a" returned: 0 in 0.626s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:12 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a Jul 30 16:43:12 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:12 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-04faf451-3471-4697-9444-a8536db5f17a" returned: 0 in 0.390s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-quobyte-04faf451-3471-4697-9444-a8536db5f17a" released by "delete_volume" :: held 1.085s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Created reservations ['4e45cc97-f19e-44d4-b707-787f37663663', '6070423a-205b-4761-8453-138bbcc6c7a4', '17c4d547-d69b-41ca-99fc-170e751cdd46', '5520b988-e5aa-43b8-b99c-92cd70f77584'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:12 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:43:12 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:12 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.347s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:12 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Deleted volume successfully. Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bcae7e64-4680-459a-81d8-65c0e3740316 tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-04faf451-3471-4697-9444-a8536db5f17a-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "cinder-ef2309b4-859d-44e6-a8fe-fc0c52cb938a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-ef2309b4-859d-44e6-a8fe-fc0c52cb938a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "cinder-quobyte-ef2309b4-859d-44e6-a8fe-fc0c52cb938a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-quobyte-ef2309b4-859d-44e6-a8fe-fc0c52cb938a" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[64df18b7-4e17-4b9f-907a-405897edb92c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:14 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a Jul 30 16:43:14 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:14 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a" returned: 0 in 0.459s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:14 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a Jul 30 16:43:14 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:14 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ef2309b4-859d-44e6-a8fe-fc0c52cb938a" returned: 0 in 0.499s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-quobyte-ef2309b4-859d-44e6-a8fe-fc0c52cb938a" released by "delete_volume" :: held 1.011s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Created reservations ['8f5112f2-d689-428d-8569-b0b6270bac67', '8882e630-ce02-43a3-9636-0e8b457f691e', 'e52906dc-d74c-4120-9be9-0d450eb94a86', 'ee635653-c077-43b5-b6c6-6cf00d26cc25'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:15 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:43:15 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:15 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Deleted volume successfully. Jul 30 16:43:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7ad181b2-ec5b-4447-b63d-f17c533c6f7f tempest-AttachVolumeTestJSON-954158415 None] Lock "cinder-ef2309b4-859d-44e6-a8fe-fc0c52cb938a-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-09e4e08a-525c-4213-9b59-dd0a58e70dde tempest-TestShelveInstance-132142685 None] Terminate volume connection completed successfully. Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-09e4e08a-525c-4213-9b59-dd0a58e70dde tempest-TestShelveInstance-132142685 None] Deleting attachment 8117b10d-6f1e-4017-a610-d7a72465c0d1. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Acquiring lock "cinder-d7cabccc-6d50-4888-87e0-ea8c20c6a49e-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Lock "cinder-d7cabccc-6d50-4888-87e0-ea8c20c6a49e-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Acquiring lock "cinder-quobyte-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Lock "cinder-quobyte-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[253deaf5-5ca2-452e-af03-96111dc59501]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:22 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e Jul 30 16:43:22 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:22 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" returned: 0 in 0.647s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:22 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e Jul 30 16:43:22 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:22 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" returned: 0 in 0.335s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Lock "cinder-quobyte-d7cabccc-6d50-4888-87e0-ea8c20c6a49e" released by "delete_volume" :: held 1.069s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG cinder.quota [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Created reservations ['5cc856ce-bf26-45d0-a057-90ac3a50170a', 'a937addf-f638-4f58-8e54-3695d8719332', '32a32a73-bb1e-4d42-b380-8950034786cb', '110bd861-87d2-402b-9462-b130da23802d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:23 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:43:23 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:23 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.308s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG cinder.manager [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Deleted volume successfully. Jul 30 16:43:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-f03047ec-ba1e-4185-b494-bb250f4138d4 req-70ea1e73-84ec-4164-bbc2-486f124793ca tempest-TestShelveInstance-132142685 None] Lock "cinder-d7cabccc-6d50-4888-87e0-ea8c20c6a49e-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Flow 'volume_create_manager' (18710f5e-d6c6-4924-bd1e-4ae8fa427b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1422a3-4736-49f5-b4d7-0bf36345b857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1422a3-4736-49f5-b4d7-0bf36345b857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1371880159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a882c10e-1e13-4350-85e0-739a4a00785a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da29189db7e94d1b9cb6ec452a14016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:31Z,use_quota=True,user_id='c59d53c0834e4ebb903df7cff7105a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962d09d3-ca31-4817-aa1b-42f913a247c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962d09d3-ca31-4817-aa1b-42f913a247c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35eec231-2684-47d6-b194-efd3b8445351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35eec231-2684-47d6-b194-efd3b8445351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a882c10e-1e13-4350-85e0-739a4a00785a', 'volume_name': 'volume-a882c10e-1e13-4350-85e0-739a4a00785a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09670ca-1bca-45aa-9742-b4d9f855cd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09670ca-1bca-45aa-9742-b4d9f855cd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6a754d-f293-40a6-b96b-5cfab748ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:30 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Volume a882c10e-1e13-4350-85e0-739a4a00785a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a882c10e-1e13-4350-85e0-739a4a00785a', 'volume_size': 1} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1371880159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a882c10e-1e13-4350-85e0-739a4a00785a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da29189db7e94d1b9cb6ec452a14016e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:31Z,use_quota=True,user_id='c59d53c0834e4ebb903df7cff7105a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Creating volume a882c10e-1e13-4350-85e0-739a4a00785a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:30 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:43:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:30 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a 1073741824 Jul 30 16:43:30 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:31 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a 1073741824" returned: 0 in 0.566s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:31 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a Jul 30 16:43:31 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:31 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a" returned: 0 in 0.345s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6a754d-f293-40a6-b96b-5cfab748ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a882c10e-1e13-4350-85e0-739a4a00785a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06114aa3-ad4e-482f-a2c7-e6d5b78d0e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Volume volume-a882c10e-1e13-4350-85e0-739a4a00785a (a882c10e-1e13-4350-85e0-739a4a00785a): created successfully Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06114aa3-ad4e-482f-a2c7-e6d5b78d0e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Flow 'volume_create_manager' (18710f5e-d6c6-4924-bd1e-4ae8fa427b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-70816539-8a3e-41c1-af0a-44a641cd7375 req-c59799fd-2cf3-4fbd-bd64-9de51c33932a tempest-VolumesGetTestJSON-2050129140 None] Created volume successfully. Jul 30 16:43:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Acquiring lock "cinder-a882c10e-1e13-4350-85e0-739a4a00785a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Lock "cinder-a882c10e-1e13-4350-85e0-739a4a00785a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Acquiring lock "cinder-quobyte-a882c10e-1e13-4350-85e0-739a4a00785a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:43:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Lock "cinder-quobyte-a882c10e-1e13-4350-85e0-739a4a00785a" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:43:33 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb072c21-a6a1-4c3f-a751-6cebd7008f80]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:33 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a Jul 30 16:43:33 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:34 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a" returned: 0 in 0.451s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a Jul 30 16:43:34 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:34 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a882c10e-1e13-4350-85e0-739a4a00785a" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Lock "cinder-quobyte-a882c10e-1e13-4350-85e0-739a4a00785a" released by "delete_volume" :: held 0.826s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG cinder.quota [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Created reservations ['ce0190f8-e1fe-4640-b8f9-ec88f758efb1', 'd7365af8-bfd6-4e9d-b6f7-195e71fa336b', '7a0a2599-d31a-44b1-aae0-d569f42f4a9e', 'eaf34e46-0c47-4972-a651-badff76549a2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:34 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:43:34 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:34 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:34 devstack cinder-volume[88380]: DEBUG cinder.manager [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:34 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Deleted volume successfully. Jul 30 16:43:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [req-04072ba2-d85c-4cb7-ad86-d1cf17ae92f7 req-2c8d2b12-4ca2-4e5c-b01b-e2345bbcad62 tempest-VolumesGetTestJSON-2050129140 None] Lock "cinder-a882c10e-1e13-4350-85e0-739a4a00785a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=83,cinder:UPDATE=86,cinder:INSERT=14,cinder:DELETE=8 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=80,cinder:UPDATE=67,cinder:INSERT=18,cinder:DELETE=3 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Flow 'volume_create_manager' (e0876962-6f3d-4598-b15e-76b5ec651033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe73d45-02e9-4408-bf3a-b33d09204c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe73d45-02e9-4408-bf3a-b33d09204c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-31267917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb41480-47b0-4d8b-8f00-104cdff2f2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6ef64668fa47628534abe6863cda84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:41Z,use_quota=True,user_id='7c60947a525d4ebcb9b0e78cca394a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0ba0b3-b271-4eeb-a22c-e743656b0bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0ba0b3-b271-4eeb-a22c-e743656b0bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c08c9a-776f-4bb6-b54c-fe14ba9643c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c08c9a-776f-4bb6-b54c-fe14ba9643c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb41480-47b0-4d8b-8f00-104cdff2f2d7', 'volume_name': 'volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb2b7b9-1a9f-4ef8-93b4-5fd7f91f1a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb2b7b9-1a9f-4ef8-93b4-5fd7f91f1a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc7e47-44fe-481d-af22-1fde72884c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Volume 6cb41480-47b0-4d8b-8f00-104cdff2f2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7', 'volume_size': 1} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-31267917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb41480-47b0-4d8b-8f00-104cdff2f2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6ef64668fa47628534abe6863cda84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:41Z,use_quota=True,user_id='7c60947a525d4ebcb9b0e78cca394a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Creating volume 6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:43:40 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:43:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:40 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 1073741824 Jul 30 16:43:40 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:41 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 1073741824" returned: 0 in 0.648s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:41 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 Jul 30 16:43:41 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:41 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc7e47-44fe-481d-af22-1fde72884c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec8af5d-dffd-4e7f-af41-526d5cc793b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:41 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Volume volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 (6cb41480-47b0-4d8b-8f00-104cdff2f2d7): created successfully Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec8af5d-dffd-4e7f-af41-526d5cc793b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Flow 'volume_create_manager' (e0876962-6f3d-4598-b15e-76b5ec651033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8159901c-b249-4e8b-a928-cfd2103704b0 tempest-TestImageHashVerification-87360944 None] Created volume successfully. Jul 30 16:43:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b9a3ff85-d938-4a25-9e6b-07a058048513 tempest-GroupSnapshotsTest-479629496 None] Group tempest-GroupSnapshotsTest-Group-1013248627: creating Jul 30 16:43:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b9a3ff85-d938-4a25-9e6b-07a058048513 tempest-GroupSnapshotsTest-479629496 None] Group tempest-GroupSnapshotsTest-Group-1013248627: created successfully Jul 30 16:43:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b9a3ff85-d938-4a25-9e6b-07a058048513 tempest-GroupSnapshotsTest-479629496 None] Create group completed successfully. Jul 30 16:43:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0277a8-9924-4387-8b5f-0de2a73bc844]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:44 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 Jul 30 16:43:44 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:44 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" returned: 0 in 0.393s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:44 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2224b6-f223-40a0-8a60-061a33c3b61e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:44 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 Jul 30 16:43:44 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:44 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 /opt/stack/data/cinder/conversion/6cb41480-47b0-4d8b-8f00-104cdff2f2d7.temp_image.26e1a1a9-2225-4755-b743-b313a145440dcjl87am9.img {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:44 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 /opt/stack/data/cinder/conversion/6cb41480-47b0-4d8b-8f00-104cdff2f2d7.temp_image.26e1a1a9-2225-4755-b743-b313a145440dcjl87am9.img Jul 30 16:43:44 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-a872e192-9560-4dab-a63c-8d58e858b1f5 req-54e2617f-e7ea-4780-924b-7bf99e25e70c tempest-AttachVolumeNegativeTest-253340097 None] Terminate volume connection completed successfully. Jul 30 16:43:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-a872e192-9560-4dab-a63c-8d58e858b1f5 req-54e2617f-e7ea-4780-924b-7bf99e25e70c tempest-AttachVolumeNegativeTest-253340097 None] Deleting attachment f9e24ea2-25ff-4b0e-b48d-d53f4c7e23b1. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:43:45 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (3904a65d-22fc-4d67-a15d-d5c6236e9581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1139796-9a83-4004-81df-cf5f6ae2d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1139796-9a83-4004-81df-cf5f6ae2d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560751359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ba6b7c0-f617-465f-ac81-763bd5a67300,host='devstack@QuobyteHD#QuobyteHD',id=7da59298-e17c-4a6b-bdfe-03390f425d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:46Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c939ca0f-b52d-449b-9dbc-62847b01ea96),volume_type_id=c939ca0f-b52d-449b-9dbc-62847b01ea96)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3465a404-3a7e-4ce3-aee5-1e3669b8f4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3465a404-3a7e-4ce3-aee5-1e3669b8f4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0447483f-8a28-419c-991d-8ffc2b93d2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0447483f-8a28-419c-991d-8ffc2b93d2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da59298-e17c-4a6b-bdfe-03390f425d4e', 'volume_name': 'volume-7da59298-e17c-4a6b-bdfe-03390f425d4e', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c47e0f-6e59-4e66-9bac-cae5a85c9734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c47e0f-6e59-4e66-9bac-cae5a85c9734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db2006c-eff1-4d71-9868-0adb34afa62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Volume 7da59298-e17c-4a6b-bdfe-03390f425d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da59298-e17c-4a6b-bdfe-03390f425d4e', 'volume_size': 1} Jul 30 16:43:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:50 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 /opt/stack/data/cinder/conversion/6cb41480-47b0-4d8b-8f00-104cdff2f2d7.temp_image.26e1a1a9-2225-4755-b743-b313a145440dcjl87am9.img" returned: 0 in 5.670s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:50 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[39773077-e376-47f7-9b20-fdcd66997a82]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:50 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 Jul 30 16:43:50 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:51 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" returned: 0 in 0.617s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/conversion/6cb41480-47b0-4d8b-8f00-104cdff2f2d7.temp_image.26e1a1a9-2225-4755-b743-b313a145440dcjl87am9.img {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:43:51 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Converted 1024.00 MB image at 180.57 MB/s Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] 26e1a1a9-2225-4755-b743-b313a145440d was raw, no need to convert to raw {{(pid=88380) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Flow 'volume_create_manager' (7a214c27-ad5e-420a-8071-494bb66f63a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965b1d54-c4d3-4ab0-aeb3-6dc7af87f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965b1d54-c4d3-4ab0-aeb3-6dc7af87f726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e6ba65-7711-4000-8be6-d99d5e0e9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac54e81af8c4a0693564e5f05a82115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:51Z,use_quota=True,user_id='43e2a8ef33d14a6ab6d6eab68a33186d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69a30eb7-8dc1-493d-8383-c42c347447d6),volume_type_id=69a30eb7-8dc1-493d-8383-c42c347447d6)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3755b5-3f87-4658-9cac-16333daf5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3755b5-3f87-4658-9cac-16333daf5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345bdb7e-6c00-4c84-b7cd-66372c28315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345bdb7e-6c00-4c84-b7cd-66372c28315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90e6ba65-7711-4000-8be6-d99d5e0e9272', 'volume_name': 'volume-90e6ba65-7711-4000-8be6-d99d5e0e9272', 'volume_size': 1, 'image_id': '2987264a-87a1-4001-8699-6983ea85fef0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2987264a-87a1-4001-8699-6983ea85fef0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a57bcce4a793e3458c434ade8f59a48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aac54e81af8c4a0693564e5f05a82115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a0f9baab2ee213c19a0d5733251453cf4375cbad254f423252af7967bb6d12014c1cde9b30395211ed935cc16db7ea8b8b6f4405c2b655ef8a9c191f9b97757', 'id': '2987264a-87a1-4001-8699-6983ea85fef0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2987264a-87a1-4001-8699-6983ea85fef0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0533b918-42ea-4a23-b89a-f963751baabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0533b918-42ea-4a23-b89a-f963751baabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbea667-ef10-48b1-851f-92dcd4ac5276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:43:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Volume 90e6ba65-7711-4000-8be6-d99d5e0e9272: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90e6ba65-7711-4000-8be6-d99d5e0e9272', 'volume_size': 1, 'image_id': '2987264a-87a1-4001-8699-6983ea85fef0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2987264a-87a1-4001-8699-6983ea85fef0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a57bcce4a793e3458c434ade8f59a48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aac54e81af8c4a0693564e5f05a82115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a0f9baab2ee213c19a0d5733251453cf4375cbad254f423252af7967bb6d12014c1cde9b30395211ed935cc16db7ea8b8b6f4405c2b655ef8a9c191f9b97757', 'id': '2987264a-87a1-4001-8699-6983ea85fef0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2987264a-87a1-4001-8699-6983ea85fef0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Trying to clone 90e6ba65-7711-4000-8be6-d99d5e0e9272 from image 2987264a-87a1-4001-8699-6983ea85fef0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2987264a-87a1-4001-8699-6983ea85fef0', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:43:51 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d411c72f-91e0-41a1-b3e6-a20403c3f993]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:52 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD Jul 30 16:43:52 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:52 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:52 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD Jul 30 16:43:52 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:52 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Temporary image 2987264a-87a1-4001-8699-6983ea85fef0 is fetched for user 43e2a8ef33d14a6ab6d6eab68a33186d. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[987be5ac-5288-45f5-804d-0f8768de2dc8]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:43:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:53 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD Jul 30 16:43:53 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:53 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:53 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD Jul 30 16:43:53 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:53 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD" returned: 1 in 0.469s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:43:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:43:54 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:43:54 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:43:54 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:43:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:44:02 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:02 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.214s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Uploaded volume to glance image-id: 26e1a1a9-2225-4755-b743-b313a145440d. {{(pid=88380) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.809s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ba6b7c0-f617-465f-ac81-763bd5a67300,created_at=2026-07-30T14:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560751359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ba6b7c0-f617-465f-ac81-763bd5a67300,host='devstack@QuobyteHD#QuobyteHD',id=7da59298-e17c-4a6b-bdfe-03390f425d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:46Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c939ca0f-b52d-449b-9dbc-62847b01ea96),volume_type_id=c939ca0f-b52d-449b-9dbc-62847b01ea96)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Creating volume 7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:14 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:14 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e 1073741824 Jul 30 16:44:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6252edb9-4fdf-4dfd-bf3c-6de75417b53a tempest-TestImageHashVerification-87360944 None] Copy volume to image completed successfully. Jul 30 16:44:14 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:14 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e 1073741824" returned: 0 in 0.628s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:14 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e Jul 30 16:44:14 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:15 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e" returned: 0 in 0.290s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.307s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e6ba65-7711-4000-8be6-d99d5e0e9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac54e81af8c4a0693564e5f05a82115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:43:51Z,use_quota=True,user_id='43e2a8ef33d14a6ab6d6eab68a33186d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69a30eb7-8dc1-493d-8383-c42c347447d6),volume_type_id=69a30eb7-8dc1-493d-8383-c42c347447d6)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Creating volume 90e6ba65-7711-4000-8be6-d99d5e0e9272 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:15 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db2006c-eff1-4d71-9868-0adb34afa62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da59298-e17c-4a6b-bdfe-03390f425d4e', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972c5ddc-683c-4240-8f92-03e7b7db0b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:15 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 1073741824 Jul 30 16:44:15 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:15 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Volume volume-7da59298-e17c-4a6b-bdfe-03390f425d4e (7da59298-e17c-4a6b-bdfe-03390f425d4e): created successfully Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972c5ddc-683c-4240-8f92-03e7b7db0b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (3904a65d-22fc-4d67-a15d-d5c6236e9581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Acquiring lock "cinder-6cb41480-47b0-4d8b-8f00-104cdff2f2d7-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ebe88110-003b-441f-ad20-39ce568f4363 tempest-GroupSnapshotsTest-479629496 None] Created volume successfully. Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Lock "cinder-6cb41480-47b0-4d8b-8f00-104cdff2f2d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Acquiring lock "cinder-quobyte-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Lock "cinder-quobyte-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2588b8-279c-4721-9e07-ef8243707e07]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:15 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 Jul 30 16:44:15 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:15 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 1073741824" returned: 0 in 0.511s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:15 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" returned: 0 in 0.387s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:15 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 Jul 30 16:44:15 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:15 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7 Jul 30 16:44:15 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:15 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272" returned: 0 in 0.247s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:15 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" returned: 0 in 0.248s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Lock "cinder-quobyte-6cb41480-47b0-4d8b-8f00-104cdff2f2d7" released by "delete_volume" :: held 0.678s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:15 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Attempting download of 2987264a-87a1-4001-8699-6983ea85fef0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2987264a-87a1-4001-8699-6983ea85fef0', 'metadata': {}}])) to volume 90e6ba65-7711-4000-8be6-d99d5e0e9272. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fdf576-5bd4-45ed-acef-a50414ed3ee2]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Created reservations ['9aa3973f-6e95-4c02-ad3b-217429de100a', '66804fb5-6126-44ab-baed-5d28c941894a', 'afc4cc9b-17be-471b-a58f-7274bef7e474', '5a5d48cb-f8d9-48bf-abab-f237d7008528'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:16 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc Jul 30 16:44:16 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:16 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:16 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] GroupSnapshot 0cffc3e8-3cb9-4a52-8998-d70c706871b9: creating. Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Group snapshot 0cffc3e8-3cb9-4a52-8998-d70c706871b9: creating. {{(pid=88380) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Creating offline snapshot b43e66e8-dfcc-4335-84f5-245ddf74e23d of volume 7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a98f8a-398f-449c-be5d-c58f2015cb1b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:16 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:16 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Deleted volume successfully. Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc" returned: 0 in 0.440s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-05620495-a76e-4db6-8216-ee4f08860010 tempest-TestImageHashVerification-87360944 None] Lock "cinder-6cb41480-47b0-4d8b-8f00-104cdff2f2d7-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:16 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e Jul 30 16:44:16 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:16 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc Jul 30 16:44:16 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:16 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e" returned: 0 in 0.420s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:16 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d 1G Jul 30 16:44:16 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:16 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc" returned: 1 in 0.400s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2987264a-87a1-4001-8699-6983ea85fef0_df6wpvgc' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b49adb-8c4b-4536-8a00-ae53b1753641]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD Jul 30 16:44:17 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d 1G" returned: 0 in 0.399s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da59298-e17c-4a6b-bdfe-03390f425d4e -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da59298-e17c-4a6b-bdfe-03390f425d4e -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d Jul 30 16:44:17 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD Jul 30 16:44:17 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7da59298-e17c-4a6b-bdfe-03390f425d4e -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d" returned: 0 in 0.333s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d Jul 30 16:44:17 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] 2987264a-87a1-4001-8699-6983ea85fef0 was raw, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 Jul 30 16:44:17 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:17 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d" returned: 0 in 0.271s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:17 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info Jul 30 16:44:17 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:18 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272" returned: 0 in 0.512s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2987264a-87a1-4001-8699-6983ea85fef0_ub04m06ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:44:18 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:18 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 1G Jul 30 16:44:18 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:18 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info" returned: 0 in 0.312s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:18 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:18 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info Jul 30 16:44:18 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:18 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.info" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:18 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.154s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 1G" returned: 0 in 0.355s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Downloaded image 2987264a-87a1-4001-8699-6983ea85fef0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2987264a-87a1-4001-8699-6983ea85fef0', 'metadata': {}}])) to volume 90e6ba65-7711-4000-8be6-d99d5e0e9272 successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Temporary image 2987264a-87a1-4001-8699-6983ea85fef0 for user 43e2a8ef33d14a6ab6d6eab68a33186d is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Marking volume 90e6ba65-7711-4000-8be6-d99d5e0e9272 as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Copying metadata from image 2987264a-87a1-4001-8699-6983ea85fef0 to 90e6ba65-7711-4000-8be6-d99d5e0e9272. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Creating volume glance metadata for volume 90e6ba65-7711-4000-8be6-d99d5e0e9272 backed by image 2987264a-87a1-4001-8699-6983ea85fef0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2987264a-87a1-4001-8699-6983ea85fef0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5a57bcce4a793e3458c434ade8f59a48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:44:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2c260dcc-89bb-4f10-8382-f3ffa927ee19 tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0cffc3e8-3cb9-4a52-8998-d70c706871b9: created successfully Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbea667-ef10-48b1-851f-92dcd4ac5276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e6ba65-7711-4000-8be6-d99d5e0e9272', 'volume_size': 1, 'image_id': '2987264a-87a1-4001-8699-6983ea85fef0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2987264a-87a1-4001-8699-6983ea85fef0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5a57bcce4a793e3458c434ade8f59a48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aac54e81af8c4a0693564e5f05a82115', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a0f9baab2ee213c19a0d5733251453cf4375cbad254f423252af7967bb6d12014c1cde9b30395211ed935cc16db7ea8b8b6f4405c2b655ef8a9c191f9b97757', 'id': '2987264a-87a1-4001-8699-6983ea85fef0', 'created_at': datetime.datetime(2026, 7, 30, 14, 43, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 43, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2987264a-87a1-4001-8699-6983ea85fef0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c77cc0-71b8-4da4-bca1-4d479841d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:18 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Volume volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 (90e6ba65-7711-4000-8be6-d99d5e0e9272): created successfully Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c77cc0-71b8-4da4-bca1-4d479841d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Flow 'volume_create_manager' (7a214c27-ad5e-420a-8071-494bb66f63a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-07da1380-e127-4394-94fd-49ad5fbddc99 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Created volume successfully. Jul 30 16:44:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Acquiring lock "cinder-90e6ba65-7711-4000-8be6-d99d5e0e9272-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "cinder-90e6ba65-7711-4000-8be6-d99d5e0e9272-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Acquiring lock "cinder-quobyte-90e6ba65-7711-4000-8be6-d99d5e0e9272" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "cinder-quobyte-90e6ba65-7711-4000-8be6-d99d5e0e9272" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc026ac-190b-47e5-add1-d38758badb4c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:20 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 Jul 30 16:44:20 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-b43e66e8-dfcc-4335-84f5-245ddf74e23d-645e2521-a26f-4db8-9287-396dff630cfd" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-b43e66e8-dfcc-4335-84f5-245ddf74e23d-645e2521-a26f-4db8-9287-396dff630cfd" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Creating volume 645e2521-a26f-4db8-9287-396dff630cfd from snapshot b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-645e2521-a26f-4db8-9287-396dff630cfd" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-645e2521-a26f-4db8-9287-396dff630cfd" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] snapshot: b43e66e8-dfcc-4335-84f5-245ddf74e23d, volume: 645e2521-a26f-4db8-9287-396dff630cfd, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0599ec-eca3-4f8d-a9cc-bc250cfac2f8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:20 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272" returned: 0 in 0.477s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:20 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d Jul 30 16:44:20 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:20 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272 Jul 30 16:44:20 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:20 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-90e6ba65-7711-4000-8be6-d99d5e0e9272" returned: 0 in 0.303s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "cinder-quobyte-90e6ba65-7711-4000-8be6-d99d5e0e9272" released by "delete_volume" :: held 0.845s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:20 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7da59298-e17c-4a6b-bdfe-03390f425d4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13111d0-0959-4be8-ad2f-b1066f7e6276]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:21 devstack cinder-volume[88380]: WARNING cinder.quota [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:44:21 devstack cinder-volume[88380]: WARNING cinder.quota [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Created reservations ['96a11932-eee9-4a18-94b1-6bee5118debb', 'fe3746d9-41c0-4f72-bca3-bd622d9bac01', '3255db16-76a1-4f78-aaa8-ecfeb5944e9a', 'd6742745-7562-4669-a572-20394e754b6a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:21 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e Jul 30 16:44:21 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:21 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:21 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:21 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e" returned: 0 in 0.482s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:21 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.337s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Deleted volume successfully. Jul 30 16:44:21 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd Jul 30 16:44:21 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3f465109-2f8e-4910-9c47-1bdeaef3fc58 tempest-VolumeAndVolumeTypeFromImageTest-1184241348 None] Lock "cinder-90e6ba65-7711-4000-8be6-d99d5e0e9272-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:27 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Flow 'volume_create_manager' (7d057108-82cc-490d-a9db-91da82ef3973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb21aadb-13f9-4ee8-a50f-17baefbfbaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd" returned: 0 in 6.054s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:44:27 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Converted 1024.00 MB image at 169.13 MB/s Jul 30 16:44:27 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb21aadb-13f9-4ee8-a50f-17baefbfbaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-375262441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc8125d-cebf-4274-9062-57e457d5d884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115f268796f744bc87d7cdf418bf283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:27Z,use_quota=True,user_id='625642d733a344d898e49fb5214b9af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:27 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb3a380-fddb-47d0-ba0f-51def529dfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:27 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb3a380-fddb-47d0-ba0f-51def529dfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62052910-a3bf-4f98-bf77-9c70bf909bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62052910-a3bf-4f98-bf77-9c70bf909bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc8125d-cebf-4274-9062-57e457d5d884', 'volume_name': 'volume-3bc8125d-cebf-4274-9062-57e457d5d884', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7618e9ea-3e9e-4f20-8086-7dc445099363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7618e9ea-3e9e-4f20-8086-7dc445099363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914116b1-cf20-4f70-94b3-752cff15f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:27 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Volume 3bc8125d-cebf-4274-9062-57e457d5d884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc8125d-cebf-4274-9062-57e457d5d884', 'volume_size': 1} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:27 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-645e2521-a26f-4db8-9287-396dff630cfd" released by "_copy_volume_from_snapshot" :: held 7.433s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-b43e66e8-dfcc-4335-84f5-245ddf74e23d-645e2521-a26f-4db8-9287-396dff630cfd" released by "_create_volume_from_snapshot" :: held 7.523s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.543s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-375262441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc8125d-cebf-4274-9062-57e457d5d884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115f268796f744bc87d7cdf418bf283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:27Z,use_quota=True,user_id='625642d733a344d898e49fb5214b9af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Creating volume 3bc8125d-cebf-4274-9062-57e457d5d884 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:27 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:27 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 1073741824 Jul 30 16:44:27 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:28 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-01766c2a-dd46-4f45-9e3b-fb606c95bd9f tempest-GroupSnapshotsTest-479629496 None] Create group from source-snapshot-0cffc3e8-3cb9-4a52-8998-d70c706871b9 completed successfully. Jul 30 16:44:28 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 1073741824" returned: 0 in 0.536s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:28 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 Jul 30 16:44:28 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:28 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884" returned: 0 in 0.323s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914116b1-cf20-4f70-94b3-752cff15f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc8125d-cebf-4274-9062-57e457d5d884', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1e95ac-7299-45f2-a4b3-11c66265c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:28 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Volume volume-3bc8125d-cebf-4274-9062-57e457d5d884 (3bc8125d-cebf-4274-9062-57e457d5d884): created successfully Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1e95ac-7299-45f2-a4b3-11c66265c915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Flow 'volume_create_manager' (7d057108-82cc-490d-a9db-91da82ef3973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:28 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f3c58b0a-648f-463c-8a6e-abc69dc2c23c tempest-AttachVolumeNegativeTest-253340097 None] Created volume successfully. Jul 30 16:44:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-645e2521-a26f-4db8-9287-396dff630cfd" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-645e2521-a26f-4db8-9287-396dff630cfd" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:29 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf1582f-3a5c-4674-ad48-5e4ed0bfca99]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:29 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd Jul 30 16:44:29 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:30 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd" returned: 0 in 0.573s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:30 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd Jul 30 16:44:30 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:30 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-645e2521-a26f-4db8-9287-396dff630cfd" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-645e2521-a26f-4db8-9287-396dff630cfd" released by "delete_volume" :: held 1.036s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:30 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Created reservations ['bab41b23-6271-491a-9f69-2f2f18a04663'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:30 devstack cinder-volume[88380]: WARNING cinder.quota [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1096932032 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1096932032, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:44:30 devstack cinder-volume[88380]: WARNING cinder.quota [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1096932032 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1096932032, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:44:30 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Created reservations ['83704799-a5ef-4f84-ad74-e18b938460ef', 'b92c9bd0-03b8-4d22-8f8b-246b5456de56', '1f8ca901-0e84-4019-ae95-ae8d6186a5bb', 'dfa8ff1a-57dc-4cb8-ab4b-33cc46ac7163'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:31 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:31 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (7c3e6a2b-a6c1-4c4b-ac5d-ee77ea33e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafcc26c-2c86-4be7-9f03-d8079afd7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafcc26c-2c86-4be7-9f03-d8079afd7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403502941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c0f27d-8617-42cc-a3d2-70ead320adf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:31Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ea1b1a-42c9-4a8b-b70a-17a365087d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ea1b1a-42c9-4a8b-b70a-17a365087d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1c7e9f-f2ce-4426-a875-efce3bb03a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1c7e9f-f2ce-4426-a875-efce3bb03a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30c0f27d-8617-42cc-a3d2-70ead320adf9', 'volume_name': 'volume-30c0f27d-8617-42cc-a3d2-70ead320adf9', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb26057-fd3e-4637-8f33-fe96ddc0e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb26057-fd3e-4637-8f33-fe96ddc0e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822e8005-5b7d-4aba-89da-ef32515df72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Volume 30c0f27d-8617-42cc-a3d2-70ead320adf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30c0f27d-8617-42cc-a3d2-70ead320adf9', 'volume_size': 1} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403502941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30c0f27d-8617-42cc-a3d2-70ead320adf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:31Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Creating volume 30c0f27d-8617-42cc-a3d2-70ead320adf9 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:31 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:31 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 1073741824 Jul 30 16:44:31 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-efb94283-579e-46bd-8131-256f388fcc1f req-54fd1265-5fdb-4027-a482-d7b5cbc39ade tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:31 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.323s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-cc23ca77-9cc2-4ebf-95fb-b91593649abc tempest-GroupSnapshotsTest-479629496 None] Delete group completed successfully. Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (80ac6c48-9121-4cd8-aaf7-b90384c68946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51805e8-fbd7-498f-b37a-7763b10212c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 1073741824" returned: 0 in 0.584s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51805e8-fbd7-498f-b37a-7763b10212c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365321492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c04064-999e-4ca9-98e7-bd79cbcc56c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:32Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2580fa4b-37f4-432d-bbc3-2c192a258092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2580fa4b-37f4-432d-bbc3-2c192a258092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180a8862-a9eb-48ac-8c83-159ea7deb412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180a8862-a9eb-48ac-8c83-159ea7deb412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49c04064-999e-4ca9-98e7-bd79cbcc56c2', 'volume_name': 'volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e68a074-c1ab-444c-a6d6-bce6635ca0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e68a074-c1ab-444c-a6d6-bce6635ca0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46db3651-3ccb-49ae-a823-75e6ae499fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Volume 49c04064-999e-4ca9-98e7-bd79cbcc56c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2', 'volume_size': 1} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:31 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 Jul 30 16:44:31 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:32 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-efb94283-579e-46bd-8131-256f388fcc1f req-54fd1265-5fdb-4027-a482-d7b5cbc39ade tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.881s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822e8005-5b7d-4aba-89da-ef32515df72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30c0f27d-8617-42cc-a3d2-70ead320adf9', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed57617b-2575-4750-97d8-21ab72b82338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-efb94283-579e-46bd-8131-256f388fcc1f req-54fd1265-5fdb-4027-a482-d7b5cbc39ade tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-365321492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49c04064-999e-4ca9-98e7-bd79cbcc56c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:32Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Creating volume 49c04064-999e-4ca9-98e7-bd79cbcc56c2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:32 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:32 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 1073741824 Jul 30 16:44:32 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (0c641611-6d4d-4b25-bdaf-809a778a5f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69169f5-0009-4f88-ab58-12e18fc17318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Volume volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 (30c0f27d-8617-42cc-a3d2-70ead320adf9): created successfully Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed57617b-2575-4750-97d8-21ab72b82338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (7c3e6a2b-a6c1-4c4b-ac5d-ee77ea33e827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69169f5-0009-4f88-ab58-12e18fc17318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1707595850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066f078a-64aa-4b7e-bfcf-e685c40e5626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:32Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a79cdd2-1a1c-4fff-980f-13b75c9cb6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a79cdd2-1a1c-4fff-980f-13b75c9cb6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c4e72d-6b4d-40b5-a74f-9ec93fd32580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c4e72d-6b4d-40b5-a74f-9ec93fd32580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066f078a-64aa-4b7e-bfcf-e685c40e5626', 'volume_name': 'volume-066f078a-64aa-4b7e-bfcf-e685c40e5626', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00af179-432c-41ac-bbb6-a4ebfaba25ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00af179-432c-41ac-bbb6-a4ebfaba25ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed77425-5062-4752-9bb2-233ff3538fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Volume 066f078a-64aa-4b7e-bfcf-e685c40e5626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066f078a-64aa-4b7e-bfcf-e685c40e5626', 'volume_size': 1} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6b8a5337-d4c9-47d8-a749-43382ef6f504 tempest-CreateVolumesFromImageTest-331692741 None] Created volume successfully. Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-efb94283-579e-46bd-8131-256f388fcc1f req-54fd1265-5fdb-4027-a482-d7b5cbc39ade tempest-AttachVolumeNegativeTest-253340097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-3bc8125d-cebf-4274-9062-57e457d5d884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41b9aae1-b38d-44d6-be02-2af8402a1332', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:44:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-efb94283-579e-46bd-8131-256f388fcc1f req-54fd1265-5fdb-4027-a482-d7b5cbc39ade tempest-AttachVolumeNegativeTest-253340097 None] attachment_update completed successfully. Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (3f05c54d-0b37-4d26-802c-7ee35f5cafba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5721bc2b-bc1d-41a7-ae74-e7d476e011d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:32 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 1073741824" returned: 0 in 0.648s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5721bc2b-bc1d-41a7-ae74-e7d476e011d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601656849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3527ad5b-37e3-4178-b856-1738419f036f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:33Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6eedafb-2ebb-4b73-8bdd-acc9f61badbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6eedafb-2ebb-4b73-8bdd-acc9f61badbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc0931f-1426-4490-b86b-7dc70f05e971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc0931f-1426-4490-b86b-7dc70f05e971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3527ad5b-37e3-4178-b856-1738419f036f', 'volume_name': 'volume-3527ad5b-37e3-4178-b856-1738419f036f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70bf749-188b-48d5-8dbc-3f52b208b2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70bf749-188b-48d5-8dbc-3f52b208b2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795bd10d-cdaa-42fe-b829-1f891c45e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Volume 3527ad5b-37e3-4178-b856-1738419f036f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3527ad5b-37e3-4178-b856-1738419f036f', 'volume_size': 1} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0cffc3e8-3cb9-4a52-8998-d70c706871b9: deleting Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0cffc3e8-3cb9-4a52-8998-d70c706871b9: deleting {{(pid=88380) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-7da59298-e17c-4a6b-bdfe-03390f425d4e" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:33 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 Jul 30 16:44:33 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-7da59298-e17c-4a6b-bdfe-03390f425d4e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-b43e66e8-dfcc-4335-84f5-245ddf74e23d" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-b43e66e8-dfcc-4335-84f5-245ddf74e23d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Deleting offline snapshot b43e66e8-dfcc-4335-84f5-245ddf74e23d of volume 7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] snapshot_file for this snap is: volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba1d87-dac9-4847-8558-3cc1c126458e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (92bc1858-201f-44c7-a2bf-76bcb85a6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480da691-229c-4039-807e-bbecd91f446c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480da691-229c-4039-807e-bbecd91f446c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208766018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e966d22d-b370-49f8-8bf1-b5f9b14cbd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:33Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863d8f6-5836-4da5-a939-4afec8846989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a863d8f6-5836-4da5-a939-4afec8846989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bbdca2-099a-484d-9bfc-e5287b71f3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bbdca2-099a-484d-9bfc-e5287b71f3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e966d22d-b370-49f8-8bf1-b5f9b14cbd50', 'volume_name': 'volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ec7e8a-c316-4865-8728-395e944c0470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ec7e8a-c316-4865-8728-395e944c0470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f54a4d-ce5b-407d-938f-3f85d5d9d29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d Jul 30 16:44:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Volume e966d22d-b370-49f8-8bf1-b5f9b14cbd50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50', 'volume_size': 1} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:33 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:33 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2" returned: 0 in 0.434s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.054s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1707595850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066f078a-64aa-4b7e-bfcf-e685c40e5626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:32Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Creating volume 066f078a-64aa-4b7e-bfcf-e685c40e5626 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:33 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:33 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 1073741824 Jul 30 16:44:33 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46db3651-3ccb-49ae-a823-75e6ae499fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05925975-0fd5-471d-a12f-b13538419597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Volume volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 (49c04064-999e-4ca9-98e7-bd79cbcc56c2): created successfully Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05925975-0fd5-471d-a12f-b13538419597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (80ac6c48-9121-4cd8-aaf7-b90384c68946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a147a4a1-b2d7-49c4-a88b-dc6fc94c7b74 tempest-CreateVolumesFromImageTest-331692741 None] Created volume successfully. Jul 30 16:44:33 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d" returned: 0 in 0.621s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7da59298-e17c-4a6b-bdfe-03390f425d4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[05088403-db1d-4a2e-b96f-f47431e68deb]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:34 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e Jul 30 16:44:34 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:34 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 1073741824" returned: 0 in 0.673s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:34 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 Jul 30 16:44:34 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:34 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626" returned: 0 in 0.323s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601656849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3527ad5b-37e3-4178-b856-1738419f036f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:33Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Creating volume 3527ad5b-37e3-4178-b856-1738419f036f {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:34 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:34 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e" returned: 0 in 0.704s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:34 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f 1073741824 Jul 30 16:44:34 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed77425-5062-4752-9bb2-233ff3538fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066f078a-64aa-4b7e-bfcf-e685c40e5626', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfa99d2-591b-4ad8-a425-ad0abdcf4fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:34 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d Jul 30 16:44:34 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Volume volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 (066f078a-64aa-4b7e-bfcf-e685c40e5626): created successfully Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfa99d2-591b-4ad8-a425-ad0abdcf4fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (0c641611-6d4d-4b25-bdaf-809a778a5f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:34 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-907c2898-c84e-462b-8b3f-da08ed66c809 tempest-CreateVolumesFromImageTest-331692741 None] Created volume successfully. Jul 30 16:44:35 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d" returned: 0 in 0.443s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:35 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d Jul 30 16:44:35 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:35 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f 1073741824" returned: 0 in 0.603s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:35 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f Jul 30 16:44:35 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:35 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e.b43e66e8-dfcc-4335-84f5-245ddf74e23d" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-b43e66e8-dfcc-4335-84f5-245ddf74e23d" released by "_delete_snapshot" :: held 2.351s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-7da59298-e17c-4a6b-bdfe-03390f425d4e" released by "delete_snapshot" :: held 2.391s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:35 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f" returned: 0 in 0.373s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.168s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208766018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e966d22d-b370-49f8-8bf1-b5f9b14cbd50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cec8e46af90c488bbb9666460f4758ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:33Z,use_quota=True,user_id='f87274421050458eb9ee179cdf227a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Creating volume e966d22d-b370-49f8-8bf1-b5f9b14cbd50 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:35 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795bd10d-cdaa-42fe-b829-1f891c45e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3527ad5b-37e3-4178-b856-1738419f036f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:35 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 1073741824 Jul 30 16:44:35 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6728c2-7b06-4694-ae62-1c50e8645eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:35 devstack cinder-volume[88380]: WARNING cinder.quota [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1096932032 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1096932032, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:44:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Volume volume-3527ad5b-37e3-4178-b856-1738419f036f (3527ad5b-37e3-4178-b856-1738419f036f): created successfully Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6728c2-7b06-4694-ae62-1c50e8645eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (3f05c54d-0b37-4d26-802c-7ee35f5cafba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0ec1384c-3117-4fcb-aef0-6c2bda185de3 tempest-CreateVolumesFromImageTest-331692741 None] Created volume successfully. Jul 30 16:44:35 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] Created reservations ['293387ea-65f4-4ac8-bca0-44c203a26028', 'a05aed75-ed0f-46ce-bffb-8b89d10d3661', '86ba1b6a-1087-43df-9818-3afcef964e77', 'aea13b11-6adc-4963-af25-ac58f6130bcc'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d53838a-ab54-4e85-a484-eb3386616f8b tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0cffc3e8-3cb9-4a52-8998-d70c706871b9: deleted successfully Jul 30 16:44:36 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 1073741824" returned: 0 in 0.703s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:36 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 Jul 30 16:44:36 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-afb7f958-3d9d-4ced-ab88-41306a5fd0da req-8c00264a-6c3b-4fee-9eb4-d8f74ef6c70a tempest-AttachVolumeNegativeTest-253340097 None] Terminate volume connection completed successfully. Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-afb7f958-3d9d-4ced-ab88-41306a5fd0da req-8c00264a-6c3b-4fee-9eb4-d8f74ef6c70a tempest-AttachVolumeNegativeTest-253340097 None] Deleting attachment 41b9aae1-b38d-44d6-be02-2af8402a1332. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:44:36 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50" returned: 0 in 0.292s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f54a4d-ce5b-407d-938f-3f85d5d9d29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227111ee-e183-48fb-8c5e-01e3a0f6ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:36 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Volume volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 (e966d22d-b370-49f8-8bf1-b5f9b14cbd50): created successfully Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227111ee-e183-48fb-8c5e-01e3a0f6ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Flow 'volume_create_manager' (92bc1858-201f-44c7-a2bf-76bcb85a6683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-723adebe-1031-4df4-bc81-bb17f7d31938 tempest-CreateVolumesFromImageTest-331692741 None] Created volume successfully. Jul 30 16:44:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-7da59298-e17c-4a6b-bdfe-03390f425d4e" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-7da59298-e17c-4a6b-bdfe-03390f425d4e" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[25407d01-955e-4bc1-8fcb-5ca97b128b02]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:37 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e Jul 30 16:44:37 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:37 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e" returned: 0 in 0.498s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:37 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e Jul 30 16:44:37 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-e966d22d-b370-49f8-8bf1-b5f9b14cbd50-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-e966d22d-b370-49f8-8bf1-b5f9b14cbd50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-quobyte-e966d22d-b370-49f8-8bf1-b5f9b14cbd50" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-e966d22d-b370-49f8-8bf1-b5f9b14cbd50" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:38 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7da59298-e17c-4a6b-bdfe-03390f425d4e" returned: 0 in 0.502s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fd112e-2bde-43b0-ad80-247f51f75bfe]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-7da59298-e17c-4a6b-bdfe-03390f425d4e" released by "delete_volume" :: held 1.102s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['16301f64-5dbe-499c-91e9-0098443df5b3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:38 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 Jul 30 16:44:38 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:38 devstack cinder-volume[88380]: WARNING cinder.db.api [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1096932032'] Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['be840315-c819-4e39-80ff-1f707a54f8f3', '6910a700-08f7-4cfe-a89c-c8136e67529a', 'd71ff52d-43d9-4bd3-9e04-e683edcaeba1', 'de1b96f5-db81-4382-b72f-a69b366df5a4'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:38 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:38 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:38 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50" returned: 0 in 0.495s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:38 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50 Jul 30 16:44:38 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:38 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.302s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:38 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fdc73649-aa5d-4ea6-a25f-503a9d672369 tempest-GroupSnapshotsTest-479629496 None] Delete group completed successfully. Jul 30 16:44:39 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e966d22d-b370-49f8-8bf1-b5f9b14cbd50" returned: 0 in 0.382s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-e966d22d-b370-49f8-8bf1-b5f9b14cbd50" released by "delete_volume" :: held 0.938s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Created reservations ['3967e979-42f1-4f7d-9635-d745311de3a7', '9572f3e9-02e3-4687-bb4b-63f43b1a3803', '332b89a0-e07d-4bba-9cf9-1f7bb3d63cef', 'c10a1158-b172-439f-af21-c4aad1b09071'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:39 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:39 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-27a57f84-67cc-4067-8105-911ae0ff893c tempest-GroupSnapshotsTest-479629496 None] Group tempest-GroupSnapshotsTest-Group-672113963: creating Jul 30 16:44:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-27a57f84-67cc-4067-8105-911ae0ff893c tempest-GroupSnapshotsTest-479629496 None] Group tempest-GroupSnapshotsTest-Group-672113963: created successfully Jul 30 16:44:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-27a57f84-67cc-4067-8105-911ae0ff893c tempest-GroupSnapshotsTest-479629496 None] Create group completed successfully. Jul 30 16:44:39 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.471s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Deleted volume successfully. Jul 30 16:44:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ca60a233-aecf-4ade-914b-0c52e453f47a tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-e966d22d-b370-49f8-8bf1-b5f9b14cbd50-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-3527ad5b-37e3-4178-b856-1738419f036f-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-3527ad5b-37e3-4178-b856-1738419f036f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-quobyte-3527ad5b-37e3-4178-b856-1738419f036f" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-3527ad5b-37e3-4178-b856-1738419f036f" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a74af-493d-4cf5-82c5-12a9b45a7cc7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:40 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f Jul 30 16:44:40 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:41 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f" returned: 0 in 0.644s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:41 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f Jul 30 16:44:41 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (cf02cfe2-c449-496d-b9a0-ddd3fd98d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34572bfe-48c2-4fad-9446-712fa87a0c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34572bfe-48c2-4fad-9446-712fa87a0c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1806223739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4179a3ff-364d-404a-b99a-5bea054f52a3,host='devstack@QuobyteHD#QuobyteHD',id=fb51b105-5076-4608-bd39-d900ee95c28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:41Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4),volume_type_id=8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85066a15-7cd7-48ab-9557-14894d165a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85066a15-7cd7-48ab-9557-14894d165a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1976420d-63fc-4887-922d-eba93dc30dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1976420d-63fc-4887-922d-eba93dc30dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb51b105-5076-4608-bd39-d900ee95c28a', 'volume_name': 'volume-fb51b105-5076-4608-bd39-d900ee95c28a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1823d437-98d7-4ef5-8843-4f4c6bc77259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1823d437-98d7-4ef5-8843-4f4c6bc77259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d06e7f4-5e07-4086-a33a-c9aeea6a7156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:41 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Volume fb51b105-5076-4608-bd39-d900ee95c28a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb51b105-5076-4608-bd39-d900ee95c28a', 'volume_size': 1} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4179a3ff-364d-404a-b99a-5bea054f52a3,created_at=2026-07-30T14:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1806223739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4179a3ff-364d-404a-b99a-5bea054f52a3,host='devstack@QuobyteHD#QuobyteHD',id=fb51b105-5076-4608-bd39-d900ee95c28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:41Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4),volume_type_id=8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Creating volume fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:41 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:41 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3527ad5b-37e3-4178-b856-1738419f036f" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:41 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a 1073741824 Jul 30 16:44:41 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-3527ad5b-37e3-4178-b856-1738419f036f" released by "delete_volume" :: held 1.092s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Created reservations ['cafc7357-98c5-400b-b9fc-08b13ed3556f', '5a2e47b0-cc0f-4ae7-ab62-bb26bb54ea5a', '92d346ff-c2bf-4cd2-a1dd-3369d0a48746', 'cd03b4f1-745a-4d22-bd00-3fdaefbc0433'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:41 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:41 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:42 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Deleted volume successfully. Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-649cfa6e-2b2f-4586-9577-d52dddd174cc tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-3527ad5b-37e3-4178-b856-1738419f036f-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:42 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a 1073741824" returned: 0 in 0.760s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:42 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a Jul 30 16:44:42 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:42 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a" returned: 0 in 0.370s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d06e7f4-5e07-4086-a33a-c9aeea6a7156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb51b105-5076-4608-bd39-d900ee95c28a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4056d063-5747-4fe8-8494-cea66395163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-066f078a-64aa-4b7e-bfcf-e685c40e5626-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Volume volume-fb51b105-5076-4608-bd39-d900ee95c28a (fb51b105-5076-4608-bd39-d900ee95c28a): created successfully Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4056d063-5747-4fe8-8494-cea66395163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (cf02cfe2-c449-496d-b9a0-ddd3fd98d473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-066f078a-64aa-4b7e-bfcf-e685c40e5626-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-28eeb363-b68b-47f0-a066-4cb5b13c9522 tempest-GroupSnapshotsTest-479629496 None] Created volume successfully. Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-quobyte-066f078a-64aa-4b7e-bfcf-e685c40e5626" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-066f078a-64aa-4b7e-bfcf-e685c40e5626" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb7f889-3122-47c8-89da-8b1471280c06]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:43 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 Jul 30 16:44:43 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:43 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:43 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626 Jul 30 16:44:43 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:43 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-066f078a-64aa-4b7e-bfcf-e685c40e5626" returned: 0 in 0.335s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-066f078a-64aa-4b7e-bfcf-e685c40e5626" released by "delete_volume" :: held 0.798s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Created reservations ['0e0fdbae-b813-4c68-bd1f-83e1744567bf', 'e44a6a30-bc6f-451c-ac31-170fb5c3397e', 'bca6a2ba-113b-464a-8b66-93f3b6245a25', 'fc54c0a6-8fe2-4d3d-92c2-d53d7b4bb33c'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:43 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:43 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-49c04064-999e-4ca9-98e7-bd79cbcc56c2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-49c04064-999e-4ca9-98e7-bd79cbcc56c2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-quobyte-49c04064-999e-4ca9-98e7-bd79cbcc56c2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-49c04064-999e-4ca9-98e7-bd79cbcc56c2" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f5e81-b620-432d-8da2-39e168f980d0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:44 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.376s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Deleted volume successfully. Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2f9850ff-135b-43b0-844c-1ee183247caa tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-066f078a-64aa-4b7e-bfcf-e685c40e5626-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:44 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 Jul 30 16:44:44 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (738c6d0d-3799-4edc-b3b2-f891e8ea6372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c699539-9e8e-48dc-bb5e-0f51772088de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c699539-9e8e-48dc-bb5e-0f51772088de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489740017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4179a3ff-364d-404a-b99a-5bea054f52a3,host='devstack@QuobyteHD#QuobyteHD',id=15ea4200-0783-412b-92ca-980be8c0ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:45Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4),volume_type_id=8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c971b5c-1e9e-4b92-a553-7beaa2f360c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c971b5c-1e9e-4b92-a553-7beaa2f360c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd10b8ee-3395-4d3f-aba4-2d858ebfc00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd10b8ee-3395-4d3f-aba4-2d858ebfc00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ea4200-0783-412b-92ca-980be8c0ae98', 'volume_name': 'volume-15ea4200-0783-412b-92ca-980be8c0ae98', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e8058e-8d2e-4adb-91ff-df781ff965b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e8058e-8d2e-4adb-91ff-df781ff965b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:44 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de692d6a-1652-4934-a491-00bd067b7dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Volume 15ea4200-0783-412b-92ca-980be8c0ae98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ea4200-0783-412b-92ca-980be8c0ae98', 'volume_size': 1} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4179a3ff-364d-404a-b99a-5bea054f52a3,created_at=2026-07-30T14:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489740017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4179a3ff-364d-404a-b99a-5bea054f52a3,host='devstack@QuobyteHD#QuobyteHD',id=15ea4200-0783-412b-92ca-980be8c0ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:45Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4),volume_type_id=8d00dadc-39d9-4eb2-b1c6-99e7f7a084b4)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Creating volume 15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:44 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2" returned: 0 in 0.673s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:44 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 1073741824 Jul 30 16:44:44 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:44 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2 Jul 30 16:44:44 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:45 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-49c04064-999e-4ca9-98e7-bd79cbcc56c2" returned: 0 in 0.315s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-49c04064-999e-4ca9-98e7-bd79cbcc56c2" released by "delete_volume" :: held 1.067s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Created reservations ['00f6f86b-5890-4615-b9e5-ea35332daa52', 'f382489e-4fb8-4272-bf67-d96a361636f7', 'a4e8f83c-3a82-4153-ad99-0135a6e8babf', '7bcc645f-cd69-4469-96d7-0712272fe356'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:45 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:45 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:45 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 1073741824" returned: 0 in 0.580s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:45 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 Jul 30 16:44:45 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:45 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.323s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Deleted volume successfully. Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2e9e44c9-ce06-4318-8b5f-611323463887 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-49c04064-999e-4ca9-98e7-bd79cbcc56c2-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:45 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98" returned: 0 in 0.347s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de692d6a-1652-4934-a491-00bd067b7dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ea4200-0783-412b-92ca-980be8c0ae98', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ffa864-4d28-4089-9bef-3a64517a76d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Volume volume-15ea4200-0783-412b-92ca-980be8c0ae98 (15ea4200-0783-412b-92ca-980be8c0ae98): created successfully Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ffa864-4d28-4089-9bef-3a64517a76d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (738c6d0d-3799-4edc-b3b2-f891e8ea6372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-05b3a8af-b074-4fdc-a964-f112e149d497 tempest-GroupSnapshotsTest-479629496 None] Created volume successfully. Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-30c0f27d-8617-42cc-a3d2-70ead320adf9-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-30c0f27d-8617-42cc-a3d2-70ead320adf9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "cinder-quobyte-30c0f27d-8617-42cc-a3d2-70ead320adf9" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-30c0f27d-8617-42cc-a3d2-70ead320adf9" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5c78f-ce1b-4345-9852-2e8591e34f2e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:46 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 Jul 30 16:44:46 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:46 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9" returned: 0 in 0.428s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:47 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9 Jul 30 16:44:47 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:47 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-30c0f27d-8617-42cc-a3d2-70ead320adf9" returned: 0 in 0.416s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-quobyte-30c0f27d-8617-42cc-a3d2-70ead320adf9" released by "delete_volume" :: held 0.906s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Created reservations ['ef161572-8049-46d2-acad-db5293aadbea', 'f533dd10-6ed8-4dd2-9295-5966cfeaaab9', 'db398889-f1c7-4fcb-9ff0-6f4cbd947c4f', 'ea5a83e6-8318-4f52-8c6b-6c759b4c1d35'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:44:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e32e4493-fa07-4833-af8b-b56af59f1eb5 tempest-GroupSnapshotsTest-479629496 None] Update group completed successfully. Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:47 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:47 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:48 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.322s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:48 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Deleted volume successfully. Jul 30 16:44:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-dc19047c-6fd7-47f1-ac1d-c3a637893e79 tempest-CreateVolumesFromImageTest-331692741 None] Lock "cinder-30c0f27d-8617-42cc-a3d2-70ead320adf9-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:44:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a9510aa9-e4aa-47b2-9211-5a521fa63ddc tempest-GroupSnapshotsTest-479629496 None] Update group completed successfully. Jul 30 16:44:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7b6bf11e-8b66-4cd2-8f8f-2ea2681954f8 tempest-GroupSnapshotsTest-479629496 None] Update group completed successfully. Jul 30 16:44:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f9d95bb8-4f46-467e-ad32-e38292668836 tempest-GroupSnapshotsTest-479629496 None] Update group completed successfully. Jul 30 16:44:53 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] GroupSnapshot 245fe3dc-f8c8-4f78-a98f-8292fff2023d: creating. Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Group snapshot 245fe3dc-f8c8-4f78-a98f-8292fff2023d: creating. {{(pid=88380) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Creating offline snapshot 2b92eab1-aaab-4f3b-84d4-6e909de78172 of volume 15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f05e720-4ba6-4327-b064-b919bcc7623c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:53 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 Jul 30 16:44:53 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:53 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98" returned: 0 in 0.704s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:54 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 1G Jul 30 16:44:54 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:54 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 1G" returned: 0 in 0.599s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ea4200-0783-412b-92ca-980be8c0ae98 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:54 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ea4200-0783-412b-92ca-980be8c0ae98 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 Jul 30 16:44:54 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:54 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:44:54 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:44:55 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (ffa1c93d-1888-4656-964f-c92ae21a33fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1388f0-4598-4b69-895f-48b507112ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ea4200-0783-412b-92ca-980be8c0ae98 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172" returned: 0 in 0.479s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:55 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1388f0-4598-4b69-895f-48b507112ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1768888386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937f8aa1-6d54-4c76-b91c-d9518068e14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:55Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884ca5ed-3be9-423d-a3e2-764818c23194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:55 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (884ca5ed-3be9-423d-a3e2-764818c23194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:55 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c452cad-9783-4ab4-b619-8f307f6d1201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c452cad-9783-4ab4-b619-8f307f6d1201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937f8aa1-6d54-4c76-b91c-d9518068e14b', 'volume_name': 'volume-937f8aa1-6d54-4c76-b91c-d9518068e14b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5078b-9e01-4705-ad39-0e2206642e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f5078b-9e01-4705-ad39-0e2206642e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90559d-37dd-4596-ab50-40202ea5bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:44:55 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume 937f8aa1-6d54-4c76-b91c-d9518068e14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937f8aa1-6d54-4c76-b91c-d9518068e14b', 'volume_size': 1} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:55 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.516s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:44:55 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:55 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info Jul 30 16:44:55 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:55 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info" returned: 0 in 0.535s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:55 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:56 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info Jul 30 16:44:56 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:56 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.info" returned: 0 in 0.497s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Creating offline snapshot 67b17f3b-6c64-423c-863c-874e4ff3e0e4 of volume fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf51a2-c577-4e0e-a619-a82ad9b75433]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:44:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:56 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a Jul 30 16:44:56 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:57 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a" returned: 0 in 0.545s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:57 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 1G Jul 30 16:44:57 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:57 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 1G" returned: 0 in 0.703s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb51b105-5076-4608-bd39-d900ee95c28a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:57 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb51b105-5076-4608-bd39-d900ee95c28a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 Jul 30 16:44:57 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:58 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb51b105-5076-4608-bd39-d900ee95c28a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4" returned: 0 in 0.436s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:58 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:58 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 Jul 30 16:44:58 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:58 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4" returned: 0 in 0.433s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:58 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info Jul 30 16:44:58 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:59 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info" returned: 0 in 0.397s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:59 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:59 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info Jul 30 16:44:59 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:59 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.info" returned: 0 in 0.388s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.038s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.364s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1768888386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937f8aa1-6d54-4c76-b91c-d9518068e14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:44:55Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating volume 937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:44:59 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:44:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:44:59 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b 1073741824 Jul 30 16:44:59 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:44:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4a21953e-ee47-4dca-8858-65f017696c23 tempest-GroupSnapshotsTest-479629496 None] group_snapshot 245fe3dc-f8c8-4f78-a98f-8292fff2023d: created successfully Jul 30 16:45:00 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b 1073741824" returned: 0 in 0.636s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:00 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b Jul 30 16:45:00 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:00 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b" returned: 0 in 0.530s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb90559d-37dd-4596-ab50-40202ea5bf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937f8aa1-6d54-4c76-b91c-d9518068e14b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23915e2-d091-4df5-bacb-2a9d6b7b83d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:00 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume volume-937f8aa1-6d54-4c76-b91c-d9518068e14b (937f8aa1-6d54-4c76-b91c-d9518068e14b): created successfully Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23915e2-d091-4df5-bacb-2a9d6b7b83d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (ffa1c93d-1888-4656-964f-c92ae21a33fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a3956e2d-ca92-46bd-b395-5ecc3f9ce0ca tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created volume successfully. Jul 30 16:45:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] group_snapshot 245fe3dc-f8c8-4f78-a98f-8292fff2023d: deleting Jul 30 16:45:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] group_snapshot 245fe3dc-f8c8-4f78-a98f-8292fff2023d: deleting {{(pid=88380) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-15ea4200-0783-412b-92ca-980be8c0ae98" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-15ea4200-0783-412b-92ca-980be8c0ae98" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-2b92eab1-aaab-4f3b-84d4-6e909de78172" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-2b92eab1-aaab-4f3b-84d4-6e909de78172" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Deleting offline snapshot 2b92eab1-aaab-4f3b-84d4-6e909de78172 of volume 15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] snapshot_file for this snap is: volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6928707c-e931-45fd-a6df-d822be96a7e8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:01 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 Jul 30 16:45:01 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:01 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172" returned: 0 in 0.670s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ea4200-0783-412b-92ca-980be8c0ae98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f0bca9-78b7-4f84-83df-57db2e1b2342]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:02 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 Jul 30 16:45:02 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating offline snapshot 015652a9-81d4-48a1-88bc-9c53779172d5 of volume 937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee371f66-3b4f-41ca-b8b0-802d6edc357d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:02 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b Jul 30 16:45:02 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:02 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98" returned: 0 in 0.849s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:02 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 Jul 30 16:45:02 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:02 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b" returned: 0 in 0.766s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:02 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 1G Jul 30 16:45:02 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:03 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172" returned: 0 in 0.707s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:03 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172 Jul 30 16:45:03 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:03 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 1G" returned: 0 in 0.884s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937f8aa1-6d54-4c76-b91c-d9518068e14b -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:03 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:03 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937f8aa1-6d54-4c76-b91c-d9518068e14b -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 Jul 30 16:45:03 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98.2b92eab1-aaab-4f3b-84d4-6e909de78172" returned: 0 in 0.529s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-2b92eab1-aaab-4f3b-84d4-6e909de78172" released by "_delete_snapshot" :: held 2.938s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-15ea4200-0783-412b-92ca-980be8c0ae98" released by "delete_snapshot" :: held 2.976s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-fb51b105-5076-4608-bd39-d900ee95c28a" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-fb51b105-5076-4608-bd39-d900ee95c28a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-67b17f3b-6c64-423c-863c-874e4ff3e0e4" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-67b17f3b-6c64-423c-863c-874e4ff3e0e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Deleting offline snapshot 67b17f3b-6c64-423c-863c-874e4ff3e0e4 of volume fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] snapshot_file for this snap is: volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[36250e99-2521-40e9-9006-6600336d4081]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:04 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 Jul 30 16:45:04 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:04 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-937f8aa1-6d54-4c76-b91c-d9518068e14b -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5" returned: 0 in 0.647s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:04 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 is being set with open permissions: ugo+rw Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:04 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 Jul 30 16:45:04 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:04 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4" returned: 0 in 0.521s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb51b105-5076-4608-bd39-d900ee95c28a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[247aed65-5c6d-4d5b-92e5-a3851f5a21c4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:04 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5" returned: 0 in 0.348s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:04 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a Jul 30 16:45:04 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:04 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info Jul 30 16:45:04 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:05 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:05 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info is being set with open permissions: ugo+rw Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:05 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a" returned: 0 in 0.463s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:05 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info Jul 30 16:45:05 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:05 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 Jul 30 16:45:05 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:05 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.info" returned: 0 in 0.415s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:05 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:05 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-555c1527-d02f-4368-84ff-739c82d971e2 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Create snapshot completed successfully Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4" returned: 0 in 0.518s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:05 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4 Jul 30 16:45:05 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Flow 'volume_create_manager' (506bc5fb-ff29-402f-8299-056b69c2af9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee737bf-fb10-4202-a1b2-2dfd48ada3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee737bf-fb10-4202-a1b2-2dfd48ada3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-803408333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21a857f-3f50-472d-9b4f-d502d008dd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f313d0edf7e540e18bfd665830107cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:06Z,use_quota=True,user_id='34a2b59d20594b429a5e44d3ec193990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaea839-40d1-4956-b8f0-56c19bbffcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaea839-40d1-4956-b8f0-56c19bbffcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376da6b6-fab2-4e52-aaba-8275bfce4a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376da6b6-fab2-4e52-aaba-8275bfce4a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21a857f-3f50-472d-9b4f-d502d008dd4d', 'volume_name': 'volume-d21a857f-3f50-472d-9b4f-d502d008dd4d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7396e5df-e26c-4977-a42b-de6979c18278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7396e5df-e26c-4977-a42b-de6979c18278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f732975e-6cf5-4a6c-86c6-00328e25f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:05 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Volume d21a857f-3f50-472d-9b4f-d502d008dd4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21a857f-3f50-472d-9b4f-d502d008dd4d', 'volume_size': 1} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-803408333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21a857f-3f50-472d-9b4f-d502d008dd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f313d0edf7e540e18bfd665830107cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:06Z,use_quota=True,user_id='34a2b59d20594b429a5e44d3ec193990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Creating volume d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:05 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:05 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d 1073741824 Jul 30 16:45:05 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:06 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a.67b17f3b-6c64-423c-863c-874e4ff3e0e4" returned: 0 in 0.328s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-67b17f3b-6c64-423c-863c-874e4ff3e0e4" released by "_delete_snapshot" :: held 1.974s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-fb51b105-5076-4608-bd39-d900ee95c28a" released by "delete_snapshot" :: held 2.013s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:06 devstack cinder-volume[88380]: WARNING cinder.quota [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1021056851 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1021056851, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:06 devstack cinder-volume[88380]: WARNING cinder.quota [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1021056851 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1021056851, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['3f532494-9021-4afc-98dd-9525e7f88497', 'c055813d-d643-4b4f-b8ff-097a0fd670f3', 'e0c16ccf-c675-43d1-acd6-3a0f6ff68509', '3f984973-3ecd-4497-8d09-7983c0793fe2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['3769ee41-e63e-4e1d-924d-fdaca655c3a0', '7addef63-c3c5-4bc3-a62f-d92133b1f196', '3ba8706a-9b6b-4122-885d-bc93cc7ad819', 'e8363c6a-2180-48ef-8dcc-f04d7e59d3f2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:06 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d 1073741824" returned: 0 in 0.632s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c53efdeb-53df-43ee-b6fd-7955affac256 tempest-GroupSnapshotsTest-479629496 None] group_snapshot 245fe3dc-f8c8-4f78-a98f-8292fff2023d: deleted successfully Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:06 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d Jul 30 16:45:06 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:06 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d" returned: 0 in 0.355s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f732975e-6cf5-4a6c-86c6-00328e25f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21a857f-3f50-472d-9b4f-d502d008dd4d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13bf1ae-069a-4cbf-adc2-dcc1a5240b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Volume volume-d21a857f-3f50-472d-9b4f-d502d008dd4d (d21a857f-3f50-472d-9b4f-d502d008dd4d): created successfully Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13bf1ae-069a-4cbf-adc2-dcc1a5240b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Flow 'volume_create_manager' (506bc5fb-ff29-402f-8299-056b69c2af9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2cb65c06-a4d6-4d1b-b37a-632046dad63e tempest-TestStampPattern-1707302050 None] Created volume successfully. Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (b1e03bad-2cf9-4582-9d0a-89540382a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a77f2f-b683-48dd-be1a-e12a0a8d98be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a77f2f-b683-48dd-be1a-e12a0a8d98be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844873819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2bb101-70f0-4178-a3c0-ed78784849fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:07Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd687475-bcd2-4334-8357-9cdf65c792f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd687475-bcd2-4334-8357-9cdf65c792f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da77d54-a9c8-445b-ad7a-7d1cbec3d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da77d54-a9c8-445b-ad7a-7d1cbec3d53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2bb101-70f0-4178-a3c0-ed78784849fb', 'volume_name': 'volume-be2bb101-70f0-4178-a3c0-ed78784849fb', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fad827-981a-4462-b15c-17118d6d6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fad827-981a-4462-b15c-17118d6d6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784febdd-2b2d-490d-b76e-c3a137fe001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume be2bb101-70f0-4178-a3c0-ed78784849fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2bb101-70f0-4178-a3c0-ed78784849fb', 'volume_size': 1} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844873819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2bb101-70f0-4178-a3c0-ed78784849fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:07Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating volume be2bb101-70f0-4178-a3c0-ed78784849fb {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:07 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:07 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb 1073741824 Jul 30 16:45:07 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (26d49cd5-158e-4c7c-b6a6-20d8069a55b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f0139-cb46-4e3f-82b6-3dd4df96e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f0139-cb46-4e3f-82b6-3dd4df96e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-764473077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9824d37-48ac-43b8-9d93-889fb5da5c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:08Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be62ed2-d852-42bb-8ed3-9d3725d5c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be62ed2-d852-42bb-8ed3-9d3725d5c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b410a-7834-4557-b2b1-06e8bc51e42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b410a-7834-4557-b2b1-06e8bc51e42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9824d37-48ac-43b8-9d93-889fb5da5c55', 'volume_name': 'volume-d9824d37-48ac-43b8-9d93-889fb5da5c55', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96a8058-a589-4699-8fe4-f98c42e21033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b96a8058-a589-4699-8fe4-f98c42e21033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2d1826-6451-4587-9879-5ce7652a1fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume d9824d37-48ac-43b8-9d93-889fb5da5c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9824d37-48ac-43b8-9d93-889fb5da5c55', 'volume_size': 1} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-15ea4200-0783-412b-92ca-980be8c0ae98" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-15ea4200-0783-412b-92ca-980be8c0ae98" acquired by "delete_volume" :: waited 0.048s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:08 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb 1073741824" returned: 0 in 0.919s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa759d5-0e61-4c41-a141-7ebfbdbfb333]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:08 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb Jul 30 16:45:08 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:08 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 Jul 30 16:45:08 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (6f980ce9-ebf3-47f3-b5de-dcbaf09867e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55884803-e45e-4995-8a28-6cda9de009ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55884803-e45e-4995-8a28-6cda9de009ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-790326232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:09Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b5d311-1b86-4aae-b9b3-0328c7fd6b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b5d311-1b86-4aae-b9b3-0328c7fd6b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b2044f-66a2-46ed-9242-67198e5cfb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b2044f-66a2-46ed-9242-67198e5cfb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f', 'volume_name': 'volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1c44c9-3c80-4a89-821c-8a5fcb55f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1c44c9-3c80-4a89-821c-8a5fcb55f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f8d9a9-6860-470f-afbb-c14d0cd6d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume 61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f', 'volume_size': 1} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:08 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb" returned: 0 in 0.385s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-764473077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9824d37-48ac-43b8-9d93-889fb5da5c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:08Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating volume d9824d37-48ac-43b8-9d93-889fb5da5c55 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:08 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784febdd-2b2d-490d-b76e-c3a137fe001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2bb101-70f0-4178-a3c0-ed78784849fb', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 1073741824 Jul 30 16:45:08 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33faa698-387b-4a9e-ad3a-efcd7073c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume volume-be2bb101-70f0-4178-a3c0-ed78784849fb (be2bb101-70f0-4178-a3c0-ed78784849fb): created successfully Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33faa698-387b-4a9e-ad3a-efcd7073c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (b1e03bad-2cf9-4582-9d0a-89540382a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-296b794e-eb0c-4d8f-932d-70036596e8e1 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created volume successfully. Jul 30 16:45:09 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98" returned: 0 in 0.675s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:09 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98 Jul 30 16:45:09 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (ef94dc34-1f32-4bf5-8523-aa8ef000bff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5730c268-05c6-441c-a5b0-bc3762becf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5730c268-05c6-441c-a5b0-bc3762becf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557070920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:09Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dda3d6-cce8-4a3c-b901-ed4251ef967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2dda3d6-cce8-4a3c-b901-ed4251ef967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7c823-0dc6-43b9-8b43-7ac01abdfdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7c823-0dc6-43b9-8b43-7ac01abdfdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3', 'volume_name': 'volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b11a02-162d-4ee3-809d-b7f138742282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b11a02-162d-4ee3-809d-b7f138742282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f0f3a3-4e91-449a-84a9-dbaa4b59c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:09 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3', 'volume_size': 1} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:09 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-15ea4200-0783-412b-92ca-980be8c0ae98" returned: 0 in 0.600s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-15ea4200-0783-412b-92ca-980be8c0ae98" released by "delete_volume" :: held 1.426s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-fb51b105-5076-4608-bd39-d900ee95c28a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-fb51b105-5076-4608-bd39-d900ee95c28a" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89e4f24-5e1b-4962-b26d-4ed7252deb90]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:09 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 1073741824" returned: 0 in 0.952s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:09 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 Jul 30 16:45:09 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (861eba1e-dd67-470a-af0c-492fd57de2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:09 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a Jul 30 16:45:09 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fb8628-88df-408e-9d3c-2fef3750ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fb8628-88df-408e-9d3c-2fef3750ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299368902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d0143e-337e-41ac-8e69-a5ebda5020ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:10Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8f9e04-862a-466b-a48b-2ff19a10ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8f9e04-862a-466b-a48b-2ff19a10ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8deaf1-8b15-4208-ad73-608463b4bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8deaf1-8b15-4208-ad73-608463b4bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d0143e-337e-41ac-8e69-a5ebda5020ea', 'volume_name': 'volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06ddf49-31a2-4f0f-a18f-32858aab98e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06ddf49-31a2-4f0f-a18f-32858aab98e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951c208b-e4c8-4693-bb11-6a54c377c177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:10 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume d2d0143e-337e-41ac-8e69-a5ebda5020ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea', 'volume_size': 1} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:10 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55" returned: 0 in 0.442s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-790326232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:09Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating volume 61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:10 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:10 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2d1826-6451-4587-9879-5ce7652a1fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9824d37-48ac-43b8-9d93-889fb5da5c55', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95f199a-b7e8-4cb1-9ff1-5df378212aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:10 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f 1073741824 Jul 30 16:45:10 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a" returned: 0 in 0.618s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:10 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 (d9824d37-48ac-43b8-9d93-889fb5da5c55): created successfully Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95f199a-b7e8-4cb1-9ff1-5df378212aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (26d49cd5-158e-4c7c-b6a6-20d8069a55b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:10 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a Jul 30 16:45:10 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-364aba48-88c7-49ef-ae33-9851069dac85 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created volume successfully. Jul 30 16:45:10 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fb51b105-5076-4608-bd39-d900ee95c28a" returned: 0 in 0.312s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-fb51b105-5076-4608-bd39-d900ee95c28a" released by "delete_volume" :: held 1.025s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['623be1f5-04ef-407d-8b27-440997900692'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:10 devstack cinder-volume[88380]: WARNING cinder.quota [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1021056851 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1021056851, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['9395e481-8eb8-461d-801e-42b9335b0d3a', '4a8e2b95-2dbb-463e-97d3-06134d31bba1', 'e74e822b-288b-4edf-83c1-8c2f22332964', 'c1a8a5fd-2324-4475-98b1-1d7860ba2be0'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:10 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f 1073741824" returned: 0 in 0.625s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['31af1c51-d0c0-4cbc-8f81-14b6844d5154', 'fe75726b-8c98-4439-8811-ad816ebf0c8d', '0d902a18-6192-4d9b-876a-4230932ac8a3', '80638fca-2812-4f2b-9695-e7dce1c5523d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:11 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f Jul 30 16:45:11 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:11 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:11 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:11 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f" returned: 0 in 0.296s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557070920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:09Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating volume c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:11 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f8d9a9-6860-470f-afbb-c14d0cd6d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:11 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 1073741824 Jul 30 16:45:11 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de0a81a-62bf-4405-895e-3255aab81637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:11 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f (61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f): created successfully Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de0a81a-62bf-4405-895e-3255aab81637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (6f980ce9-ebf3-47f3-b5de-dcbaf09867e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e2f08d77-0f08-49c8-a7d8-5e65427ae08d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created volume successfully. Jul 30 16:45:11 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.281s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9e06a8a4-15ac-4283-b79e-cb6f3e1fd596 tempest-GroupSnapshotsTest-479629496 None] Delete group completed successfully. Jul 30 16:45:11 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 1073741824" returned: 0 in 0.522s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:11 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 Jul 30 16:45:11 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:12 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299368902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d0143e-337e-41ac-8e69-a5ebda5020ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc503aa56f3a4c2f9520000190b9a7f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:10Z,use_quota=True,user_id='9f65ff3b778645ab9edfa096b31c7d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Creating volume d2d0143e-337e-41ac-8e69-a5ebda5020ea {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:12 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f0f3a3-4e91-449a-84a9-dbaa4b59c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:12 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea 1073741824 Jul 30 16:45:12 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0804cba0-6499-4e17-9de6-5b88634f0f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:12 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 (c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3): created successfully Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0804cba0-6499-4e17-9de6-5b88634f0f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (ef94dc34-1f32-4bf5-8523-aa8ef000bff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9b89915d-d2d2-49ae-9433-cbebcd9e39fa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created volume successfully. Jul 30 16:45:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9f462208-2844-4984-8701-5e5b4d624482 tempest-GroupSnapshotsTest-479629496 None] Group tempest-GroupSnapshotsTest-Group-1490342306: creating Jul 30 16:45:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9f462208-2844-4984-8701-5e5b4d624482 tempest-GroupSnapshotsTest-479629496 None] Group tempest-GroupSnapshotsTest-Group-1490342306: created successfully Jul 30 16:45:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9f462208-2844-4984-8701-5e5b4d624482 tempest-GroupSnapshotsTest-479629496 None] Create group completed successfully. Jul 30 16:45:13 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea 1073741824" returned: 0 in 0.898s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=151,cinder:UPDATE=188,cinder:DELETE=16,cinder:INSERT=43 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=174,cinder:SELECT=173,cinder:INSERT=46,cinder:DELETE=8 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:13 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea Jul 30 16:45:13 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:13 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] <== create_volume: return (1404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951c208b-e4c8-4693-bb11-6a54c377c177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60044293-fa54-4c15-ae72-3a057fd1ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:13 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Volume volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea (d2d0143e-337e-41ac-8e69-a5ebda5020ea): created successfully Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60044293-fa54-4c15-ae72-3a057fd1ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Flow 'volume_create_manager' (861eba1e-dd67-470a-af0c-492fd57de2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:13 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-47a3256e-d7f8-411c-915d-22406ba62306 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created volume successfully. Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (6a665482-0d9f-4191-ad1c-2e87b3781fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a0f640-2b4e-4356-a397-b4a83428c10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a0f640-2b4e-4356-a397-b4a83428c10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97595962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60f19167-8121-4938-825f-4292e7312230,host='devstack@QuobyteHD#QuobyteHD',id=99ce5ca3-4c7e-4121-87d7-391f9a6af828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:14Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(673515ed-a9f8-4ad3-8b4c-3e045d9b5f29),volume_type_id=673515ed-a9f8-4ad3-8b4c-3e045d9b5f29)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2807c306-bef9-456a-8b5d-952c02ce0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2807c306-bef9-456a-8b5d-952c02ce0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52635a28-168d-4429-8158-47ebdccb8d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52635a28-168d-4429-8158-47ebdccb8d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99ce5ca3-4c7e-4121-87d7-391f9a6af828', 'volume_name': 'volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82140afc-14ea-4c27-94a1-88a7a68df9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82140afc-14ea-4c27-94a1-88a7a68df9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c4217e-43ff-4bdf-a209-b35ab6ccdbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Volume 99ce5ca3-4c7e-4121-87d7-391f9a6af828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828', 'volume_size': 1} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60f19167-8121-4938-825f-4292e7312230,created_at=2026-07-30T14:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97595962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60f19167-8121-4938-825f-4292e7312230,host='devstack@QuobyteHD#QuobyteHD',id=99ce5ca3-4c7e-4121-87d7-391f9a6af828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ad588bece974aeba589190e965fab2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:14Z,use_quota=True,user_id='40bd9006fc6c4871a0c03beb67257166',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(673515ed-a9f8-4ad3-8b4c-3e045d9b5f29),volume_type_id=673515ed-a9f8-4ad3-8b4c-3e045d9b5f29)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Creating volume 99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:14 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:14 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 1073741824 Jul 30 16:45:14 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-d2d0143e-337e-41ac-8e69-a5ebda5020ea-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-d2d0143e-337e-41ac-8e69-a5ebda5020ea-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-d2d0143e-337e-41ac-8e69-a5ebda5020ea" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-d2d0143e-337e-41ac-8e69-a5ebda5020ea" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c146a25a-9a5d-46c8-ae97-cee786d82e63]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:15 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea Jul 30 16:45:15 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:15 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 1073741824" returned: 0 in 0.762s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:15 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 Jul 30 16:45:15 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:15 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea" returned: 0 in 0.562s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:15 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea Jul 30 16:45:15 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:15 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c4217e-43ff-4bdf-a209-b35ab6ccdbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a190d64f-d82a-4c74-b757-79d09b9ef439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:15 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Volume volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 (99ce5ca3-4c7e-4121-87d7-391f9a6af828): created successfully Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a190d64f-d82a-4c74-b757-79d09b9ef439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Flow 'volume_create_manager' (6a665482-0d9f-4191-ad1c-2e87b3781fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-35c77617-780e-4dd7-ba79-82a05f71ede8 tempest-GroupSnapshotsTest-479629496 None] Created volume successfully. Jul 30 16:45:15 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d2d0143e-337e-41ac-8e69-a5ebda5020ea" returned: 0 in 0.441s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-d2d0143e-337e-41ac-8e69-a5ebda5020ea" released by "delete_volume" :: held 1.116s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['d44416de-e456-4563-9c90-d3a0f82f857f', '1ac4c2ee-86ab-42bd-b99c-5acce59b9d94', '778b44c8-1264-4ef2-87f9-0b774048eb03', '91ac45ff-eba2-48db-8104-25041a895d64'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:16 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:16 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:16 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.261s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleted volume successfully. Jul 30 16:45:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6c1e9ab-62e6-491c-baac-ee4bb55ad303 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-d2d0143e-337e-41ac-8e69-a5ebda5020ea-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[273aaf31-e904-4ca3-83f4-3bebfe2ba90d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:17 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] GroupSnapshot 0772341e-ca9f-492d-86fe-93a57c3328bf: creating. Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Group snapshot 0772341e-ca9f-492d-86fe-93a57c3328bf: creating. {{(pid=88380) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Creating offline snapshot 414925a2-cfd0-40af-9c48-98e79918adfa of volume 99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:45:17 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 Jul 30 16:45:17 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30955b4-bc97-4533-8b26-cca0df197f4f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:17 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 Jul 30 16:45:17 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:18 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3" returned: 0 in 0.694s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:18 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3 Jul 30 16:45:18 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:18 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828" returned: 0 in 0.697s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:18 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa 1G Jul 30 16:45:18 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:18 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3" returned: 0 in 0.410s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3" released by "delete_volume" :: held 1.179s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['091c9886-be0c-4c78-aeaf-b844a16b16fa', '1a2e9e1c-a2d3-4ade-bdf9-4a76c53d23cd', '564047e3-2666-4d2e-9617-828c2eba6f91', '95b4af27-293a-467a-90e7-c6cc28216fcd'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:18 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:18 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:18 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa 1G" returned: 0 in 0.601s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:18 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa Jul 30 16:45:18 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:18 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.275s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleted volume successfully. Jul 30 16:45:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5254b110-90c8-429d-9ee2-cbe2ae43143f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-c6b16b3c-345b-4f5e-99cd-85dbcd4cbdb3-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:19 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa" returned: 0 in 0.374s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:19 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:19 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa Jul 30 16:45:19 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:19 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:19 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info Jul 30 16:45:19 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[829bb854-ed3e-4488-b418-df0a3e88ed6c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:19 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f Jul 30 16:45:19 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:20 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:20 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:20 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info Jul 30 16:45:20 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:20 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f" returned: 0 in 0.431s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:20 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f Jul 30 16:45:20 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:20 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.info" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.933s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:20 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:20 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fdfbb185-0c79-47c7-a68b-b06ad6dea66c tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0772341e-ca9f-492d-86fe-93a57c3328bf: created successfully Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f" released by "delete_volume" :: held 0.790s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['e40a4897-0423-4ba5-8812-fb97160271a5', '23e7e481-4c30-4dc9-a623-82f3b8afd8ad', 'eca76392-050c-41ce-b10b-b2ff26cbe0c5', 'bb7e3276-d6da-41fe-ad10-3a7010543436'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:20 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:20 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-d9824d37-48ac-43b8-9d93-889fb5da5c55-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-d9824d37-48ac-43b8-9d93-889fb5da5c55-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-d9824d37-48ac-43b8-9d93-889fb5da5c55" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-d9824d37-48ac-43b8-9d93-889fb5da5c55" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae2c963-dda5-4f1c-b3d8-1d71cd7484b5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0772341e-ca9f-492d-86fe-93a57c3328bf: deleting Jul 30 16:45:21 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.487s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleted volume successfully. Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0772341e-ca9f-492d-86fe-93a57c3328bf: deleting {{(pid=88380) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0d4023dd-5fe5-4364-a2fe-90ad4e812ff7 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-61950bc8-4b73-4eb1-a7ab-1ab13c0bb94f-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-99ce5ca3-4c7e-4121-87d7-391f9a6af828" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-99ce5ca3-4c7e-4121-87d7-391f9a6af828" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-414925a2-cfd0-40af-9c48-98e79918adfa" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:21 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 Jul 30 16:45:21 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-414925a2-cfd0-40af-9c48-98e79918adfa" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Deleting offline snapshot 414925a2-cfd0-40af-9c48-98e79918adfa of volume 99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] snapshot_file for this snap is: volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4b9c04-c3cd-435e-a670-8228f582bfdc]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:21 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa Jul 30 16:45:21 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:21 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55" returned: 0 in 0.510s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:21 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55 Jul 30 16:45:21 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:21 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[62380bdf-edd2-42bf-9de2-6aedb54f98e0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:21 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d9824d37-48ac-43b8-9d93-889fb5da5c55" returned: 0 in 0.298s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-d9824d37-48ac-43b8-9d93-889fb5da5c55" released by "delete_volume" :: held 0.871s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:21 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 Jul 30 16:45:21 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['596cd044-c558-4917-a307-0f1940ab4638', '7ec54e2e-41a2-459b-b382-5f08a65cd2e8', '148a9577-2355-468a-8370-f9155714018f', '0e2113b4-35dd-4e45-9414-25e62b1cc0d7'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:22 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:22 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:22 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828" returned: 0 in 0.468s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:22 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa Jul 30 16:45:22 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:22 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.299s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleted volume successfully. Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-db3fedfe-7aad-436d-80fa-5c1cfef5046d tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-d9824d37-48ac-43b8-9d93-889fb5da5c55-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:22 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa" returned: 0 in 0.528s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:22 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa Jul 30 16:45:22 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Flow 'volume_create_manager' (e85d9205-583d-429f-a2b3-360e8127ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a977031c-d612-453a-9813-a1698836c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a977031c-d612-453a-9813-a1698836c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2681919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a5a944-6659-43b9-a7cf-68ac5fa381ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115f268796f744bc87d7cdf418bf283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:23Z,use_quota=True,user_id='625642d733a344d898e49fb5214b9af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0a53e9-98cb-441e-b4ea-cb7b620da392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0a53e9-98cb-441e-b4ea-cb7b620da392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297a1e81-9913-4da6-bdfc-e20fcf4796c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297a1e81-9913-4da6-bdfc-e20fcf4796c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a5a944-6659-43b9-a7cf-68ac5fa381ed', 'volume_name': 'volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6624e980-bbd4-464d-9745-5fd819b87836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6624e980-bbd4-464d-9745-5fd819b87836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1974b7f9-1552-4cbe-9b84-28d2bcd0a48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:22 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Volume 19a5a944-6659-43b9-a7cf-68ac5fa381ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed', 'volume_size': 1} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2681919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a5a944-6659-43b9-a7cf-68ac5fa381ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115f268796f744bc87d7cdf418bf283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:23Z,use_quota=True,user_id='625642d733a344d898e49fb5214b9af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Creating volume 19a5a944-6659-43b9-a7cf-68ac5fa381ed {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:22 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:23 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed 1073741824 Jul 30 16:45:23 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:23 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828.414925a2-cfd0-40af-9c48-98e79918adfa" returned: 0 in 0.301s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-414925a2-cfd0-40af-9c48-98e79918adfa" released by "_delete_snapshot" :: held 1.839s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-99ce5ca3-4c7e-4121-87d7-391f9a6af828" released by "delete_snapshot" :: held 1.892s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-be2bb101-70f0-4178-a3c0-ed78784849fb-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-be2bb101-70f0-4178-a3c0-ed78784849fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-be2bb101-70f0-4178-a3c0-ed78784849fb" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-be2bb101-70f0-4178-a3c0-ed78784849fb" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:23 devstack cinder-volume[88380]: WARNING cinder.quota [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1065220618 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1065220618, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:23 devstack cinder-volume[88380]: WARNING cinder.quota [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1065220618 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1065220618, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[021eb040-f652-4dd6-978a-6dce53d37f40]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] Created reservations ['e6172c00-703e-4212-937f-ff5ef6ab4b1f', '6d594a23-9a85-4671-8eb7-b40901bfb840', '096f8912-63be-4ecf-b900-bc6181597225', '2324c154-666a-4502-a7c7-f82c12fb6e83'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:23 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb Jul 30 16:45:23 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3a6e9717-a7dd-4c84-a4d9-58b454d5f3db tempest-GroupSnapshotsTest-479629496 None] group_snapshot 0772341e-ca9f-492d-86fe-93a57c3328bf: deleted successfully Jul 30 16:45:23 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed 1073741824" returned: 0 in 0.661s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:23 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed Jul 30 16:45:23 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:23 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb" returned: 0 in 0.529s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:23 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb Jul 30 16:45:23 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "cinder-quobyte-99ce5ca3-4c7e-4121-87d7-391f9a6af828" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:24 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-99ce5ca3-4c7e-4121-87d7-391f9a6af828" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed" returned: 0 in 0.392s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1974b7f9-1552-4cbe-9b84-28d2bcd0a48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1799112c-ec05-4a03-9984-9ba81dd43177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae102e6e-d2c9-4968-9947-b4cf0d18f11e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:24 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Volume volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed (19a5a944-6659-43b9-a7cf-68ac5fa381ed): created successfully Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1799112c-ec05-4a03-9984-9ba81dd43177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Flow 'volume_create_manager' (e85d9205-583d-429f-a2b3-360e8127ad73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e0bb3466-31da-42ae-ad2b-eb4b5d822cb7 tempest-AttachVolumeNegativeTest-253340097 None] Created volume successfully. Jul 30 16:45:24 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-be2bb101-70f0-4178-a3c0-ed78784849fb" returned: 0 in 0.351s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-be2bb101-70f0-4178-a3c0-ed78784849fb" released by "delete_volume" :: held 0.928s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:24 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 Jul 30 16:45:24 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['8c6e7d50-d6b6-4bfd-8fea-d63f13518c0e', 'fc4accd3-ed61-40de-a109-91a2498d85db', '72cc6466-cf0c-462e-a763-cfa2c5f538ed', '9f057ef8-5bac-4529-b136-593c2684e2bb'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:24 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:24 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-015652a9-81d4-48a1-88bc-9c53779172d5-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-015652a9-81d4-48a1-88bc-9c53779172d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-937f8aa1-6d54-4c76-b91c-d9518068e14b" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-937f8aa1-6d54-4c76-b91c-d9518068e14b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-015652a9-81d4-48a1-88bc-9c53779172d5" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-015652a9-81d4-48a1-88bc-9c53779172d5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleting offline snapshot 015652a9-81d4-48a1-88bc-9c53779172d5 of volume 937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] snapshot_file for this snap is: volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[43790f0b-15a8-44ec-9351-e33d04393e3f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:24 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828" returned: 0 in 0.586s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:24 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828 Jul 30 16:45:24 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:24 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 Jul 30 16:45:24 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:24 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.452s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleted volume successfully. Jul 30 16:45:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a6c1e305-1863-4379-a46a-40481a7e4caa tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-be2bb101-70f0-4178-a3c0-ed78784849fb-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:25 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-99ce5ca3-4c7e-4121-87d7-391f9a6af828" returned: 0 in 0.368s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:25 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5" returned: 0 in 0.486s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-937f8aa1-6d54-4c76-b91c-d9518068e14b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Lock "cinder-quobyte-99ce5ca3-4c7e-4121-87d7-391f9a6af828" released by "delete_volume" :: held 1.079s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70cc870-ca7a-4f3c-86c0-1b61041ee3d4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['7ca68070-76a0-455d-a70e-257168462efb'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:25 devstack cinder-volume[88380]: WARNING cinder.quota [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1065220618 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1065220618, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Created reservations ['618593d4-a883-493a-8543-2c7b276d81dc', 'cd4cfb34-2fb4-4443-9f5a-2d9c569f3e57', '7db4b822-e72e-4767-978b-64c037526f19', '539c563b-da18-41d9-81fe-886a9574409a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:25 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b Jul 30 16:45:25 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:25 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:25 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:25 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b" returned: 0 in 0.709s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:25 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 Jul 30 16:45:25 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:25 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.493s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:25 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f9f00e46-f269-4c85-aa9c-bd87bc6ad580 tempest-GroupSnapshotsTest-479629496 None] Delete group completed successfully. Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-f7507b1c-abed-4cef-b4de-69afebbc7722 req-6491f740-ae2e-4392-ad80-714ac5c35f23 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-f7507b1c-abed-4cef-b4de-69afebbc7722 req-6491f740-ae2e-4392-ad80-714ac5c35f23 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-f7507b1c-abed-4cef-b4de-69afebbc7722 req-6491f740-ae2e-4392-ad80-714ac5c35f23 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-f7507b1c-abed-4cef-b4de-69afebbc7722 req-6491f740-ae2e-4392-ad80-714ac5c35f23 tempest-AttachVolumeNegativeTest-253340097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93913ec0-a137-4fe6-8d08-2bbae04cd32e', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:45:26 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5" returned: 0 in 0.501s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:26 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5 Jul 30 16:45:26 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-f7507b1c-abed-4cef-b4de-69afebbc7722 req-6491f740-ae2e-4392-ad80-714ac5c35f23 tempest-AttachVolumeNegativeTest-253340097 None] attachment_update completed successfully. Jul 30 16:45:26 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b.015652a9-81d4-48a1-88bc-9c53779172d5" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-015652a9-81d4-48a1-88bc-9c53779172d5" released by "_delete_snapshot" :: held 2.155s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-937f8aa1-6d54-4c76-b91c-d9518068e14b" released by "delete_snapshot" :: held 2.198s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['cdb3e9c6-7a9d-4767-a1cb-5a4315db521a', '64f17b55-fb2e-44fa-8362-574f2666dee7', '3d246bdf-fb41-4279-97d0-aa073b626a87', '37b5fdc8-07d5-4a74-9738-1cd9562c9bc8'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Delete snapshot completed successfully. Jul 30 16:45:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5859348-81ee-4aaf-aab8-52d1196c6b5f tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-015652a9-81d4-48a1-88bc-9c53779172d5-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-937f8aa1-6d54-4c76-b91c-d9518068e14b-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-937f8aa1-6d54-4c76-b91c-d9518068e14b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "cinder-quobyte-937f8aa1-6d54-4c76-b91c-d9518068e14b" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-937f8aa1-6d54-4c76-b91c-d9518068e14b" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:28 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[950df640-42ee-43a6-8753-4157695d5e82]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:28 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b Jul 30 16:45:28 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:28 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b" returned: 0 in 0.580s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:28 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b Jul 30 16:45:28 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:29 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-937f8aa1-6d54-4c76-b91c-d9518068e14b" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-quobyte-937f8aa1-6d54-4c76-b91c-d9518068e14b" released by "delete_volume" :: held 1.001s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Created reservations ['05484543-1182-4b31-b638-b93be3109383', '6b1e9d86-2add-4da1-a62f-e1041aaff0cf', 'aee691f2-21f7-4acf-b30d-b86db7346dce', 'd3c86698-0426-467b-9aa8-96f77c467457'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:29 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:29 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-16d84130-a393-42c2-969f-81d235dd8d66 req-74da4760-d41d-467e-841b-fb8ff7eef544 tempest-AttachVolumeNegativeTest-253340097 None] Terminate volume connection completed successfully. Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-16d84130-a393-42c2-969f-81d235dd8d66 req-74da4760-d41d-467e-841b-fb8ff7eef544 tempest-AttachVolumeNegativeTest-253340097 None] Deleting attachment 93913ec0-a137-4fe6-8d08-2bbae04cd32e. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:45:29 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.321s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Deleted volume successfully. Jul 30 16:45:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-648862df-25ee-4c63-9a03-82462fe57b32 tempest-CreateVolumesFromSnapshotTest-1675836468 None] Lock "cinder-937f8aa1-6d54-4c76-b91c-d9518068e14b-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dfca68ab-5f59-401d-b01b-11c21fe4facd tempest-GroupSnapshotsV319Test-1331006762 None] Group tempest-GroupSnapshotsV319Test-Group-1814718074: creating Jul 30 16:45:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dfca68ab-5f59-401d-b01b-11c21fe4facd tempest-GroupSnapshotsV319Test-1331006762 None] Group tempest-GroupSnapshotsV319Test-Group-1814718074: created successfully Jul 30 16:45:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dfca68ab-5f59-401d-b01b-11c21fe4facd tempest-GroupSnapshotsV319Test-1331006762 None] Create group completed successfully. Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "cinder-19a5a944-6659-43b9-a7cf-68ac5fa381ed-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-19a5a944-6659-43b9-a7cf-68ac5fa381ed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "cinder-quobyte-19a5a944-6659-43b9-a7cf-68ac5fa381ed" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-quobyte-19a5a944-6659-43b9-a7cf-68ac5fa381ed" acquired by "delete_volume" :: waited 0.036s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Flow 'volume_create_manager' (dfc68bff-6a67-4fd3-b38c-e38373d03d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadd706-4fba-4dbc-977d-0f348cd00a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4da75-a39f-45bb-9d8a-52fc16d01da4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaadd706-4fba-4dbc-977d-0f348cd00a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-814854498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a5d083e-f682-41ff-93ea-eab8ad780de7,host='devstack@QuobyteHD#QuobyteHD',id=e72097a2-e625-411d-8e13-ce09764f4c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3c9f4023ec44bcae72d736bcc40285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:34Z,use_quota=True,user_id='33dbd5fd30dc4572b6e205058df29321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0d6775c-5273-4567-a9ec-c2b96967cb1b),volume_type_id=c0d6775c-5273-4567-a9ec-c2b96967cb1b)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a9bf8a-f539-4850-9a89-5d4e59ef439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a9bf8a-f539-4850-9a89-5d4e59ef439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab2e08d-c908-4fbf-b668-2a1720cfb6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab2e08d-c908-4fbf-b668-2a1720cfb6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72097a2-e625-411d-8e13-ce09764f4c33', 'volume_name': 'volume-e72097a2-e625-411d-8e13-ce09764f4c33', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6cc02f-c3b2-4095-9915-1957faac959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6cc02f-c3b2-4095-9915-1957faac959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f751ee7d-9fec-40e8-8da4-88b25aa9cc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Volume e72097a2-e625-411d-8e13-ce09764f4c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72097a2-e625-411d-8e13-ce09764f4c33', 'volume_size': 1} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a5d083e-f682-41ff-93ea-eab8ad780de7,created_at=2026-07-30T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-814854498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a5d083e-f682-41ff-93ea-eab8ad780de7,host='devstack@QuobyteHD#QuobyteHD',id=e72097a2-e625-411d-8e13-ce09764f4c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3c9f4023ec44bcae72d736bcc40285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:34Z,use_quota=True,user_id='33dbd5fd30dc4572b6e205058df29321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0d6775c-5273-4567-a9ec-c2b96967cb1b),volume_type_id=c0d6775c-5273-4567-a9ec-c2b96967cb1b)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Creating volume e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:34 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:34 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 1073741824 Jul 30 16:45:34 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:34 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (219dfb7b-d073-428a-b41c-0cb3f674e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:34 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99e7ad2-1e99-4bb5-86d8-26d1753e49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99e7ad2-1e99-4bb5-86d8-26d1753e49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-287507232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93d339a-47dc-468a-906d-97f1e4bdd066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:34Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4fe7fa-b6d3-471b-8abb-ef4a5ae8e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4fe7fa-b6d3-471b-8abb-ef4a5ae8e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b6d127-a814-4826-9096-9e339c86599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b6d127-a814-4826-9096-9e339c86599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93d339a-47dc-468a-906d-97f1e4bdd066', 'volume_name': 'volume-b93d339a-47dc-468a-906d-97f1e4bdd066', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c9da10-2f72-41fc-a567-084864850b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c9da10-2f72-41fc-a567-084864850b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7ed2b6-2351-488d-9ddf-a2ad5b3cad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume b93d339a-47dc-468a-906d-97f1e4bdd066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93d339a-47dc-468a-906d-97f1e4bdd066', 'volume_size': 1} Jul 30 16:45:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:35 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed" returned: 0 in 0.504s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:35 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed Jul 30 16:45:35 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:35 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 1073741824" returned: 0 in 0.567s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:35 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 Jul 30 16:45:35 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:35 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19a5a944-6659-43b9-a7cf-68ac5fa381ed" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-quobyte-19a5a944-6659-43b9-a7cf-68ac5fa381ed" released by "delete_volume" :: held 0.921s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Created reservations ['fa1db956-aef2-4a3c-9e4d-9eed50d45265', '413b8c98-e9a1-4037-9c5a-753ba4158685', 'fc962107-8749-4a02-a3be-69ce9bbe3859', '559aa35c-ee0c-422c-ae22-43ce7990d3a3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:35 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-287507232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93d339a-47dc-468a-906d-97f1e4bdd066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:34Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Creating volume b93d339a-47dc-468a-906d-97f1e4bdd066 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:35 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f751ee7d-9fec-40e8-8da4-88b25aa9cc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72097a2-e625-411d-8e13-ce09764f4c33', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:35 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 1073741824 Jul 30 16:45:35 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc83e380-e48e-4a0d-b0a4-aad423dd7f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Volume volume-e72097a2-e625-411d-8e13-ce09764f4c33 (e72097a2-e625-411d-8e13-ce09764f4c33): created successfully Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc83e380-e48e-4a0d-b0a4-aad423dd7f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Flow 'volume_create_manager' (dfc68bff-6a67-4fd3-b38c-e38373d03d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:35 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:35 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-73bad9e4-7e81-4f88-8162-d9f917bca50c tempest-GroupSnapshotsV319Test-1331006762 None] Created volume successfully. Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "cinder-3bc8125d-cebf-4274-9062-57e457d5d884-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-3bc8125d-cebf-4274-9062-57e457d5d884-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "cinder-quobyte-3bc8125d-cebf-4274-9062-57e457d5d884" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-quobyte-3bc8125d-cebf-4274-9062-57e457d5d884" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fb9dfb-9685-43c7-8e97-9b3f1cfe653a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:35 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Deleted volume successfully. Jul 30 16:45:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-702ed401-ee45-4c30-944a-cf043bfc055c tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-19a5a944-6659-43b9-a7cf-68ac5fa381ed-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:36 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 Jul 30 16:45:36 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:36 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 1073741824" returned: 0 in 0.607s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:36 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 Jul 30 16:45:36 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:36 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884" returned: 0 in 0.418s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:36 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884 Jul 30 16:45:36 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:36 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066" returned: 0 in 0.418s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7ed2b6-2351-488d-9ddf-a2ad5b3cad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93d339a-47dc-468a-906d-97f1e4bdd066', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83eebad8-42b6-4dba-a76f-56590e96e612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:36 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3bc8125d-cebf-4274-9062-57e457d5d884" returned: 0 in 0.377s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:36 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume volume-b93d339a-47dc-468a-906d-97f1e4bdd066 (b93d339a-47dc-468a-906d-97f1e4bdd066): created successfully Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83eebad8-42b6-4dba-a76f-56590e96e612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (219dfb7b-d073-428a-b41c-0cb3f674e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-quobyte-3bc8125d-cebf-4274-9062-57e457d5d884" released by "delete_volume" :: held 0.869s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-eb98c42c-dd8d-445d-8386-50e46230fea7 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created volume successfully. Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Created reservations ['2fb9c300-c4a9-495d-bf6c-bd950d53ab7d', '623aa087-632e-4dba-9984-d72a8fab3b38', 'fc98f79e-4ee4-4a8c-ad72-b9b27470a000', '9a3714db-4e55-44a1-ba3c-086ab482e2ee'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:36 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:36 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] GroupSnapshot 09e69cef-7f07-4b19-8aef-28ec074a97bd: creating. Jul 30 16:45:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Group snapshot 09e69cef-7f07-4b19-8aef-28ec074a97bd: creating. {{(pid=88380) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Creating offline snapshot d0c23d21-4047-48cf-acd5-232ba0395a91 of volume e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26db44a-5ab8-48f8-a5a0-4d6abcda6bb6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "cinder-faf9910d-3db4-40c3-872b-2e7cd1dbe925-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:37 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 Jul 30 16:45:37 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-faf9910d-3db4-40c3-872b-2e7cd1dbe925-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:37 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.408s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "cinder-quobyte-faf9910d-3db4-40c3-872b-2e7cd1dbe925" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:37 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Deleted volume successfully. Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-quobyte-faf9910d-3db4-40c3-872b-2e7cd1dbe925" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54e33a8e-8aa2-40f1-9eb9-fcc7b6dc85a8 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-3bc8125d-cebf-4274-9062-57e457d5d884-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40335a3-1b84-4f91-8993-1959f9e4beaf]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:37 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33" returned: 0 in 0.455s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:37 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 1G Jul 30 16:45:37 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:37 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 Jul 30 16:45:37 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:37 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925" returned: 0 in 0.444s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:37 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925 Jul 30 16:45:37 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:37 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (02f4f8fe-07e3-45a6-9f61-c94e0bb043cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:38 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be466a7-f79a-4cf0-8e8c-8f0a188efed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 1G" returned: 0 in 0.535s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72097a2-e625-411d-8e13-ce09764f4c33 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be466a7-f79a-4cf0-8e8c-8f0a188efed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308782061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c4edb6-4ad7-417e-9854-9ed19af17497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:38Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7e812-45ce-40d3-a5df-a3f1efddfe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af7e812-45ce-40d3-a5df-a3f1efddfe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72097a2-e625-411d-8e13-ce09764f4c33 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 Jul 30 16:45:38 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722bce07-d605-41c5-900e-6d2b0ff4467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722bce07-d605-41c5-900e-6d2b0ff4467c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c4edb6-4ad7-417e-9854-9ed19af17497', 'volume_name': 'volume-37c4edb6-4ad7-417e-9854-9ed19af17497', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc9ec5b-b900-4649-aef6-dd115b92eda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc9ec5b-b900-4649-aef6-dd115b92eda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c627fb90-124b-4b6b-af15-17fc5d2f7fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume 37c4edb6-4ad7-417e-9854-9ed19af17497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c4edb6-4ad7-417e-9854-9ed19af17497', 'volume_size': 1} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:38 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-faf9910d-3db4-40c3-872b-2e7cd1dbe925" returned: 0 in 0.334s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-quobyte-faf9910d-3db4-40c3-872b-2e7cd1dbe925" released by "delete_volume" :: held 0.846s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Created reservations ['013acde8-127c-47ad-8aa8-997cf8f554d5', 'b0fceb9d-0ad3-4074-8ae6-aa35d5e0aa73', '58fe1192-81ce-4805-aa54-0bd60c0777a0', 'f3ba86ad-bfa4-466a-8104-47dbd8fffadd'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:38 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:38 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (0d0451c4-77da-43d0-a7ba-e5cd09234540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:38 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c773ef89-06b2-4260-9b49-a397d547e360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e72097a2-e625-411d-8e13-ce09764f4c33 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91" returned: 0 in 0.468s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c773ef89-06b2-4260-9b49-a397d547e360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1869166504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b3a60c-003f-4aef-b215-500775b2fbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:38Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4fbb3c-b571-4ac6-a42b-9dc2c73aefbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4fbb3c-b571-4ac6-a42b-9dc2c73aefbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590b78f5-31cd-4863-9b08-b751e0f676bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590b78f5-31cd-4863-9b08-b751e0f676bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b3a60c-003f-4aef-b215-500775b2fbfa', 'volume_name': 'volume-d7b3a60c-003f-4aef-b215-500775b2fbfa', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8863c7a5-cac5-400e-b440-80e9f885643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8863c7a5-cac5-400e-b440-80e9f885643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf0f628-1f62-4a21-9ee3-44b31d517cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume d7b3a60c-003f-4aef-b215-500775b2fbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b3a60c-003f-4aef-b215-500775b2fbfa', 'volume_size': 1} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:38 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.388s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Deleted volume successfully. Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d38cdc-32f7-4099-9261-3cb1470e6d09 tempest-AttachVolumeNegativeTest-253340097 None] Lock "cinder-faf9910d-3db4-40c3-872b-2e7cd1dbe925-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:38 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91" returned: 0 in 0.422s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:39 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info Jul 30 16:45:39 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (cf052655-f1af-4cfa-b88c-b1fde5885285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153b8fb9-4b65-45dc-8934-e3bc87a81a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153b8fb9-4b65-45dc-8934-e3bc87a81a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392754871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e35bfad-bfd5-43e3-8529-8191cd4e2ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:39Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a74982-b4c1-4214-bd6f-c5f852eff740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a74982-b4c1-4214-bd6f-c5f852eff740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97660fe8-3f2c-43d1-816b-fd06e302b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97660fe8-3f2c-43d1-816b-fd06e302b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e35bfad-bfd5-43e3-8529-8191cd4e2ed9', 'volume_name': 'volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7c17a8-f6c4-4042-86fe-f56c1c4e08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7c17a8-f6c4-4042-86fe-f56c1c4e08ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0543315-2764-4105-bade-15af5597c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume 7e35bfad-bfd5-43e3-8529-8191cd4e2ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9', 'volume_size': 1} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:39 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:39 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info is being set with open permissions: ugo+rw: NotImplementedError Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:39 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info Jul 30 16:45:39 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (ef8292b7-e94f-473e-899b-40be4eceace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db27d38-e8f1-464e-9c3c-9dca4a0d92d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db27d38-e8f1-464e-9c3c-9dca4a0d92d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-230321935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19133c77-ee2b-4ea5-a051-4d047516ead4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:40Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b40c3f-3e99-4dad-8799-3ed48aadc2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b40c3f-3e99-4dad-8799-3ed48aadc2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e710cc2-2e76-4a56-aaec-fcc7141ae26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e710cc2-2e76-4a56-aaec-fcc7141ae26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19133c77-ee2b-4ea5-a051-4d047516ead4', 'volume_name': 'volume-19133c77-ee2b-4ea5-a051-4d047516ead4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d88c79c-70b9-4912-9ca1-6ee9c75342a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d88c79c-70b9-4912-9ca1-6ee9c75342a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879a88aa-4622-4d7e-87fb-684f8e85f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume 19133c77-ee2b-4ea5-a051-4d047516ead4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19133c77-ee2b-4ea5-a051-4d047516ead4', 'volume_size': 1} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:39 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.info" returned: 0 in 0.416s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1308782061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c4edb6-4ad7-417e-9854-9ed19af17497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:38Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Creating volume 37c4edb6-4ad7-417e-9854-9ed19af17497 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:39 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:39 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 1073741824 Jul 30 16:45:39 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0acec95e-700b-444e-bc23-d956712d2625 tempest-GroupSnapshotsV319Test-1331006762 None] group_snapshot 09e69cef-7f07-4b19-8aef-28ec074a97bd: created successfully Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (ede6493a-eeff-4dcd-bff7-adceaa6519d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73946d16-7632-48e1-8964-fce8604d7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73946d16-7632-48e1-8964-fce8604d7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259634458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ca9040-95b0-442f-b39b-178124a29fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:40Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f836a07-409e-4b70-bc1d-7dc9fca683bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f836a07-409e-4b70-bc1d-7dc9fca683bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a18dc2f-73d2-419c-b570-00b5c1cd2aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a18dc2f-73d2-419c-b570-00b5c1cd2aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ca9040-95b0-442f-b39b-178124a29fe8', 'volume_name': 'volume-70ca9040-95b0-442f-b39b-178124a29fe8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a7b23c-236f-4b89-82db-e26fc5f46c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2a7b23c-236f-4b89-82db-e26fc5f46c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf11434f-212c-4043-a0b9-9d9cc84a226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume 70ca9040-95b0-442f-b39b-178124a29fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ca9040-95b0-442f-b39b-178124a29fe8', 'volume_size': 1} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:40 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 1073741824" returned: 0 in 0.679s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:40 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 Jul 30 16:45:40 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:40 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] group_snapshot 09e69cef-7f07-4b19-8aef-28ec074a97bd: deleting Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] group_snapshot 09e69cef-7f07-4b19-8aef-28ec074a97bd: deleting {{(pid=88380) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "cinder-quobyte-e72097a2-e625-411d-8e13-ce09764f4c33" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "cinder-quobyte-e72097a2-e625-411d-8e13-ce09764f4c33" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "cinder-quobyte-d0c23d21-4047-48cf-acd5-232ba0395a91" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "cinder-quobyte-d0c23d21-4047-48cf-acd5-232ba0395a91" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Deleting offline snapshot d0c23d21-4047-48cf-acd5-232ba0395a91 of volume e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:45:41 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] snapshot_file for this snap is: volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497" returned: 0 in 0.458s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.467s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1869166504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b3a60c-003f-4aef-b215-500775b2fbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:38Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Creating volume d7b3a60c-003f-4aef-b215-500775b2fbfa {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:41 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df386bd-0444-46aa-a8f8-595ce4b61b75]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:41 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa 1073741824 Jul 30 16:45:41 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c627fb90-124b-4b6b-af15-17fc5d2f7fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c4edb6-4ad7-417e-9854-9ed19af17497', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead2c7ed-446d-425b-9203-bf6aafaa0a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:41 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume volume-37c4edb6-4ad7-417e-9854-9ed19af17497 (37c4edb6-4ad7-417e-9854-9ed19af17497): created successfully Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead2c7ed-446d-425b-9203-bf6aafaa0a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (02f4f8fe-07e3-45a6-9f61-c94e0bb043cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c37fe081-0834-4914-85bd-eb382ee7ce91 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created volume successfully. Jul 30 16:45:41 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 Jul 30 16:45:41 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-c97e11e6-2446-427d-9539-b2dd70c39c8e req-af31bf37-fa40-4d2a-8170-b891a57b11cd tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:41 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91" returned: 0 in 0.514s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e72097a2-e625-411d-8e13-ce09764f4c33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:45:41 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa 1073741824" returned: 0 in 0.557s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d348d-4a92-403c-9669-a4786c85c0cd]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:41 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa Jul 30 16:45:41 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:41 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 Jul 30 16:45:41 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:41 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa" returned: 0 in 0.293s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.883s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-392754871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e35bfad-bfd5-43e3-8529-8191cd4e2ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:39Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Creating volume 7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:41 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf0f628-1f62-4a21-9ee3-44b31d517cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b3a60c-003f-4aef-b215-500775b2fbfa', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:42 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 1073741824 Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049298f9-d1bb-40f3-b026-a6ec799ccc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:42 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:42 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume volume-d7b3a60c-003f-4aef-b215-500775b2fbfa (d7b3a60c-003f-4aef-b215-500775b2fbfa): created successfully Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049298f9-d1bb-40f3-b026-a6ec799ccc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (0d0451c4-77da-43d0-a7ba-e5cd09234540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33" returned: 0 in 0.421s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-80e44413-a809-4b79-bca6-198cc86bcd09 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created volume successfully. Jul 30 16:45:42 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 Jul 30 16:45:42 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:42 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91" returned: 0 in 0.512s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:42 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 1073741824" returned: 0 in 0.605s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:42 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91 Jul 30 16:45:42 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:42 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 Jul 30 16:45:42 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:42 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33.d0c23d21-4047-48cf-acd5-232ba0395a91" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "cinder-quobyte-d0c23d21-4047-48cf-acd5-232ba0395a91" released by "_delete_snapshot" :: held 1.905s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Lock "cinder-quobyte-e72097a2-e625-411d-8e13-ce09764f4c33" released by "delete_snapshot" :: held 1.945s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:42 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9" returned: 0 in 0.305s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.216s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-230321935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19133c77-ee2b-4ea5-a051-4d047516ead4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:40Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Creating volume 19133c77-ee2b-4ea5-a051-4d047516ead4 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:42 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:42 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 1073741824 Jul 30 16:45:42 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0543315-2764-4105-bade-15af5597c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78783bd7-8075-41ad-8981-5471e95314d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:43 devstack cinder-volume[88380]: WARNING cinder.quota [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2057796776 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2057796776, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:43 devstack cinder-volume[88380]: WARNING cinder.quota [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2057796776 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2057796776, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 (7e35bfad-bfd5-43e3-8529-8191cd4e2ed9): created successfully Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78783bd7-8075-41ad-8981-5471e95314d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (cf052655-f1af-4cfa-b88c-b1fde5885285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-114d7324-1652-4d9c-b2df-308fe220a816 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created volume successfully. Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] Created reservations ['e1961474-38f2-4d93-8fa8-85ba90b84660', '690f0b2b-612a-4ec3-8a4f-683f4ee1cbf7', '3ca73f5f-9fb3-4248-88e7-d30976728840', 'bc120025-a561-4d0e-bfe6-bddf9ccac6ef'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7eed42ba-acfc-4a75-b2e8-d52ef1e5533c tempest-GroupSnapshotsV319Test-1331006762 None] group_snapshot 09e69cef-7f07-4b19-8aef-28ec074a97bd: deleted successfully Jul 30 16:45:43 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 1073741824" returned: 0 in 0.658s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:43 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 Jul 30 16:45:43 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "cinder-quobyte-e72097a2-e625-411d-8e13-ce09764f4c33" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:43 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Lock "cinder-quobyte-e72097a2-e625-411d-8e13-ce09764f4c33" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.783s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1259634458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ca9040-95b0-442f-b39b-178124a29fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d992af470f24ca8a5483bdaf90d0e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:45:40Z,use_quota=True,user_id='0d9a4f8dcfab46bd9d4b16797bb439c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Creating volume 70ca9040-95b0-442f-b39b-178124a29fe8 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:45:44 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a66a1b-ef4a-44b7-aeba-7a4f768ac97e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:44 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 1073741824 Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879a88aa-4622-4d7e-87fb-684f8e85f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19133c77-ee2b-4ea5-a051-4d047516ead4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:44 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e30bb63-8a03-4a7f-8605-3571b7556482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume volume-19133c77-ee2b-4ea5-a051-4d047516ead4 (19133c77-ee2b-4ea5-a051-4d047516ead4): created successfully Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e30bb63-8a03-4a7f-8605-3571b7556482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (ef8292b7-e94f-473e-899b-40be4eceace7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ba971d32-a79a-4827-be83-a92485d6f626 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created volume successfully. Jul 30 16:45:44 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 Jul 30 16:45:44 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:44 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33" returned: 0 in 0.428s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:44 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33 Jul 30 16:45:44 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:44 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 1073741824" returned: 0 in 0.585s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:44 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 Jul 30 16:45:44 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:44 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e72097a2-e625-411d-8e13-ce09764f4c33" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Lock "cinder-quobyte-e72097a2-e625-411d-8e13-ce09764f4c33" released by "delete_volume" :: held 0.838s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Created reservations ['d3347f9b-7f02-47e9-8486-2dda5a223766'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:44 devstack cinder-volume[88380]: WARNING cinder.quota [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2057796776 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2057796776, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:45:44 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8" returned: 0 in 0.299s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-c97e11e6-2446-427d-9539-b2dd70c39c8e req-af31bf37-fa40-4d2a-8170-b891a57b11cd tempest-TestStampPattern-1707302050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.478s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Created reservations ['809f39bc-737b-4434-8310-ed05a0473d5b', 'c38cf4f3-21d4-4de2-96b9-65127630a5fb', 'd7071c33-6e18-41b8-b853-f5f3c51c0d5b', '503916ac-b9cb-4682-b5f5-f29258bb66a9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf11434f-212c-4043-a0b9-9d9cc84a226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ca9040-95b0-442f-b39b-178124a29fe8', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb8519b-f056-4325-8a80-d1d04054c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-c97e11e6-2446-427d-9539-b2dd70c39c8e req-af31bf37-fa40-4d2a-8170-b891a57b11cd tempest-TestStampPattern-1707302050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Volume volume-70ca9040-95b0-442f-b39b-178124a29fe8 (70ca9040-95b0-442f-b39b-178124a29fe8): created successfully Jul 30 16:45:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb8519b-f056-4325-8a80-d1d04054c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Flow 'volume_create_manager' (ede6493a-eeff-4dcd-bff7-adceaa6519d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:45:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-869e3e23-5056-4ed0-9331-0f2962deda92 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created volume successfully. Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-c97e11e6-2446-427d-9539-b2dd70c39c8e req-af31bf37-fa40-4d2a-8170-b891a57b11cd tempest-TestStampPattern-1707302050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-d21a857f-3f50-472d-9b4f-d502d008dd4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18f133c6-b9eb-4fb0-bb04-8ab55d7e45e1', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:45:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-c97e11e6-2446-427d-9539-b2dd70c39c8e req-af31bf37-fa40-4d2a-8170-b891a57b11cd tempest-TestStampPattern-1707302050 None] attachment_update completed successfully. Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:45 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:45 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:45 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.336s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:45 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1d5eb2ad-de0a-4e89-9c52-183ba169862f tempest-GroupSnapshotsV319Test-1331006762 None] Delete group completed successfully. Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-70ca9040-95b0-442f-b39b-178124a29fe8-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-70ca9040-95b0-442f-b39b-178124a29fe8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-quobyte-70ca9040-95b0-442f-b39b-178124a29fe8" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-70ca9040-95b0-442f-b39b-178124a29fe8" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[985ca50e-0b1f-4520-8366-7e2b19200cce]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:46 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 Jul 30 16:45:46 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:46 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8" returned: 0 in 0.443s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:46 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8 Jul 30 16:45:46 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:46 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-70ca9040-95b0-442f-b39b-178124a29fe8" returned: 0 in 0.312s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-70ca9040-95b0-442f-b39b-178124a29fe8" released by "delete_volume" :: held 0.812s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created reservations ['cbe412db-dc0f-449a-b15e-ecb78c1e549d', '388ae75e-db4f-4ff4-8ae8-90c2adfcbe7b', '8fe6985e-1a84-4b33-ae8e-bff76802bdb2', '0cc5a06c-0305-401b-aa20-35dd143a7319'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:47 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:47 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5692c752-680f-4b44-8269-fd5b28b4191a tempest-BackendsCapabilitiesAdminTestsJSON-116148823 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.74658203125, 'free_capacity_gb': 1775.74658203125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88380) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-19133c77-ee2b-4ea5-a051-4d047516ead4-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-95963056-52d3-4013-9bf2-8a004a11fe7e tempest-BackendsCapabilitiesAdminTestsJSON-116148823 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.74658203125, 'free_capacity_gb': 1775.74658203125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88380) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-19133c77-ee2b-4ea5-a051-4d047516ead4-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-quobyte-19133c77-ee2b-4ea5-a051-4d047516ead4" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-19133c77-ee2b-4ea5-a051-4d047516ead4" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:47 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.396s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fdef75-7715-439d-8ec0-92ad805d11ed]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Deleted volume successfully. Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4cfb8332-691c-4d7e-b7a7-5c6435d8ad42 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-70ca9040-95b0-442f-b39b-178124a29fe8-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:47 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 Jul 30 16:45:47 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:47 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:47 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4 Jul 30 16:45:47 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-19133c77-ee2b-4ea5-a051-4d047516ead4" returned: 0 in 0.337s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-19133c77-ee2b-4ea5-a051-4d047516ead4" released by "delete_volume" :: held 0.818s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created reservations ['c38bfb2e-6724-4fa6-a4ff-8957c9cee2ca', 'becf91a1-dffe-49a3-b4a3-241fbab59d96', '245749db-9ca7-4d26-8691-73bfbe907bcb', 'aca12b33-4b19-4d2f-acff-994de63cbd18'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:48 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:48 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-quobyte-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa6a164-feec-4f6f-83f5-94d5f7e448fb]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:48 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:48 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 Jul 30 16:45:48 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.457s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:48 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Deleted volume successfully. Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4ceb8be2-b7da-477d-a0db-af52eff35926 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-19133c77-ee2b-4ea5-a051-4d047516ead4-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:49 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9" returned: 0 in 0.467s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:49 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9 Jul 30 16:45:49 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:49 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9" returned: 0 in 0.361s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9" released by "delete_volume" :: held 0.913s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created reservations ['a88d05ef-4a64-40be-af10-88eee36f938d', 'b882c5bc-0222-4f5d-87b7-0de4ac1a2b01', 'de0147c7-9749-478e-a3c7-64ccc787f873', '978da287-fb02-44ea-881f-b20520f94b06'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:49 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:49 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:50 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.337s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:50 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Deleted volume successfully. Jul 30 16:45:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dbbdfd4-4b02-44b6-a777-3895f72940ed tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-7e35bfad-bfd5-43e3-8529-8191cd4e2ed9-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-d7b3a60c-003f-4aef-b215-500775b2fbfa-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-d7b3a60c-003f-4aef-b215-500775b2fbfa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-quobyte-d7b3a60c-003f-4aef-b215-500775b2fbfa" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-d7b3a60c-003f-4aef-b215-500775b2fbfa" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ccdd69-2012-4dd9-9fb7-8d8b37cc91fa]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-827b707c-ffe6-4b71-826c-e530acedc2eb req-368a7a52-3aa6-4722-9c6a-dc3d107a46ea tempest-TestStampPattern-1707302050 None] Terminate volume connection completed successfully. Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-827b707c-ffe6-4b71-826c-e530acedc2eb req-368a7a52-3aa6-4722-9c6a-dc3d107a46ea tempest-TestStampPattern-1707302050 None] Deleting attachment 18f133c6-b9eb-4fb0-bb04-8ab55d7e45e1. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:45:51 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa Jul 30 16:45:51 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:51 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa" returned: 0 in 0.497s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:51 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa Jul 30 16:45:51 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:51 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d7b3a60c-003f-4aef-b215-500775b2fbfa" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-d7b3a60c-003f-4aef-b215-500775b2fbfa" released by "delete_volume" :: held 0.919s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Creating offline snapshot 3b9702d4-fd95-4310-acc2-0aeee2d50269 of volume d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8595c8e-d090-4882-bbeb-41fe200b8440]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created reservations ['efaf96ab-99da-47e4-b18d-c33e229d8f94', '0e89bb8f-0758-4587-9762-7e61b047bced', '32c39cee-3bb2-41f0-af25-c514fb12f9ce', 'f9438195-f5f4-4af3-bc4d-a829e2cfb057'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:52 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:52 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:52 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:52 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:52 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Deleted volume successfully. Jul 30 16:45:52 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d" returned: 0 in 0.490s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-194ab3c9-9945-497f-8d07-b39ed641a2c8 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-d7b3a60c-003f-4aef-b215-500775b2fbfa-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:52 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 1G Jul 30 16:45:52 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 1G" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21a857f-3f50-472d-9b4f-d502d008dd4d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21a857f-3f50-472d-9b4f-d502d008dd4d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 Jul 30 16:45:53 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-37c4edb6-4ad7-417e-9854-9ed19af17497-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-37c4edb6-4ad7-417e-9854-9ed19af17497-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-quobyte-37c4edb6-4ad7-417e-9854-9ed19af17497" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-37c4edb6-4ad7-417e-9854-9ed19af17497" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f78d09-31b5-448c-be78-ec39369b1dfe]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d21a857f-3f50-472d-9b4f-d502d008dd4d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269" returned: 0 in 0.366s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:53 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 is being set with open permissions: ugo+rw Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 Jul 30 16:45:53 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 Jul 30 16:45:53 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269" returned: 0 in 0.315s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:53 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497" returned: 0 in 0.405s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497 Jul 30 16:45:53 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:53 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info Jul 30 16:45:53 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:54 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37c4edb6-4ad7-417e-9854-9ed19af17497" returned: 0 in 0.388s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:54 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info" returned: 0 in 0.358s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:54 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info is being set with open permissions: ugo+rw Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-37c4edb6-4ad7-417e-9854-9ed19af17497" released by "delete_volume" :: held 0.857s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:54 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info Jul 30 16:45:54 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created reservations ['179831ba-c0fa-4df2-9c19-ba131b2ae6c7', 'cf3fcd00-ca0e-4fa3-a1ca-87c149ae9bf6', '608e73c2-4a21-42f6-bf60-2811f5561e1b', '6392c5e7-3ff0-4d0c-a26c-7227df62180b'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:54 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:54 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-b93d339a-47dc-468a-906d-97f1e4bdd066-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-b93d339a-47dc-468a-906d-97f1e4bdd066-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "cinder-quobyte-b93d339a-47dc-468a-906d-97f1e4bdd066" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-b93d339a-47dc-468a-906d-97f1e4bdd066" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:45:54 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7140be9-70a0-4dda-afc0-b25bc47bdc8f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.info" returned: 0 in 0.524s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:54 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:54 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:54 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.454s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-05ffc137-8f9c-4b15-b655-aa4b279fcba9 tempest-TestStampPattern-1707302050 None] Create snapshot completed successfully Jul 30 16:45:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Deleted volume successfully. Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c79d6c4d-e769-4475-a54b-8ab184dab310 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-37c4edb6-4ad7-417e-9854-9ed19af17497-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:54 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 Jul 30 16:45:54 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:54 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.324s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:45:55 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066" returned: 0 in 0.586s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:55 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066 Jul 30 16:45:55 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:55 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b93d339a-47dc-468a-906d-97f1e4bdd066" returned: 0 in 0.303s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-quobyte-b93d339a-47dc-468a-906d-97f1e4bdd066" released by "delete_volume" :: held 0.993s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Created reservations ['7726ca3c-46ba-40f5-a99f-acb4c9ffa655', 'd3add597-e2ec-49c7-9080-fdc5b8ba5066', 'd137550d-6257-46fd-a0db-860fa69b0abd', 'a6bd7057-fe3f-4a3d-ba83-f5894d778f07'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:45:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:45:55 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:45:55 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:45:56 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 30 16:45:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.277s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:45:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:45:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Deleted volume successfully. Jul 30 16:45:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-59083c1f-ad47-4778-b8b5-6e4ce526ae47 tempest-CreateVolumesFromSourceVolumeTest-1680663786 None] Lock "cinder-b93d339a-47dc-468a-906d-97f1e4bdd066-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-808f98bc-a94e-4e7d-af85-19fbfdff1445 tempest-GroupsTest-1401310802 None] Group tempest-Group1-1988420890: creating Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Flow 'volume_create_manager' (64feaad0-2cbd-47cf-9c9f-e3a661788717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6432c5-ab6c-4a12-b270-9bec6c7f5197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6432c5-ab6c-4a12-b270-9bec6c7f5197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1097705878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44464c26-10c6-4d83-93eb-9a75f1954193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f28adf438745f294426f8320a73e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:02Z,use_quota=True,user_id='0898ae9d09e54a10b09cf2dc8919a49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2291a5b-3c70-4402-99b9-03a2977b5f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2291a5b-3c70-4402-99b9-03a2977b5f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d8edfd-e7ff-441b-8158-759d975443fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d8edfd-e7ff-441b-8158-759d975443fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44464c26-10c6-4d83-93eb-9a75f1954193', 'volume_name': 'volume-44464c26-10c6-4d83-93eb-9a75f1954193', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055b7c30-182a-4da0-9f8e-2a7282b114f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055b7c30-182a-4da0-9f8e-2a7282b114f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed90b81-eb3d-47ab-aaf0-607a13ec6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:01 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Volume 44464c26-10c6-4d83-93eb-9a75f1954193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44464c26-10c6-4d83-93eb-9a75f1954193', 'volume_size': 1} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1097705878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44464c26-10c6-4d83-93eb-9a75f1954193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f28adf438745f294426f8320a73e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:02Z,use_quota=True,user_id='0898ae9d09e54a10b09cf2dc8919a49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Creating volume 44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:01 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-808f98bc-a94e-4e7d-af85-19fbfdff1445 tempest-GroupsTest-1401310802 None] Group tempest-Group1-1988420890: created successfully Jul 30 16:46:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-808f98bc-a94e-4e7d-af85-19fbfdff1445 tempest-GroupsTest-1401310802 None] Create group completed successfully. Jul 30 16:46:01 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 1073741824 Jul 30 16:46:01 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:02 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 1073741824" returned: 0 in 0.580s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:02 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 Jul 30 16:46:02 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fb9e8751-9de2-498b-99fb-03a9fd27a072 tempest-GroupsTest-1401310802 None] Group tempest-Group2-2080545945: creating Jul 30 16:46:02 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fb9e8751-9de2-498b-99fb-03a9fd27a072 tempest-GroupsTest-1401310802 None] Group tempest-Group2-2080545945: created successfully Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed90b81-eb3d-47ab-aaf0-607a13ec6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44464c26-10c6-4d83-93eb-9a75f1954193', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604024a3-ff12-42d5-8258-09e6bee8b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fb9e8751-9de2-498b-99fb-03a9fd27a072 tempest-GroupsTest-1401310802 None] Create group completed successfully. Jul 30 16:46:02 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Volume volume-44464c26-10c6-4d83-93eb-9a75f1954193 (44464c26-10c6-4d83-93eb-9a75f1954193): created successfully Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (604024a3-ff12-42d5-8258-09e6bee8b914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Flow 'volume_create_manager' (64feaad0-2cbd-47cf-9c9f-e3a661788717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b52c2faa-c728-4d0e-b57d-172d3a774111 tempest-VolumeDependencyTests-1771972531 None] Created volume successfully. Jul 30 16:46:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Creating offline snapshot f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 of volume 44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:46:03 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aca871-4caa-41ef-9c4a-afa576acab25]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:03 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 Jul 30 16:46:03 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:04 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:04 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 1G Jul 30 16:46:04 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Flow 'volume_create_manager' (72ddf474-9a87-48d4-b1be-e54ca1ee27d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d7ba2a-c4aa-4abb-a464-c56f29900767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d7ba2a-c4aa-4abb-a464-c56f29900767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481075803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6b623ea-78b9-4f62-b085-237af09848c7,host='devstack@QuobyteHD#QuobyteHD',id=9ca7c67b-e422-41ed-ae9b-4cd017937151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb8f8065534f80908a373fb2221e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:04Z,use_quota=True,user_id='844a498c22104e9b98928e076ef005b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0799661-d6b3-461a-b78c-0cb1654cf428),volume_type_id=c0799661-d6b3-461a-b78c-0cb1654cf428)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112a23a2-8a89-4fb8-82c4-05588b0a86a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112a23a2-8a89-4fb8-82c4-05588b0a86a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a4317e-17bf-4920-b51e-fff2834cd76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a4317e-17bf-4920-b51e-fff2834cd76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca7c67b-e422-41ed-ae9b-4cd017937151', 'volume_name': 'volume-9ca7c67b-e422-41ed-ae9b-4cd017937151', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa92887-03f9-4d9d-a6c2-42bc00dd166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa92887-03f9-4d9d-a6c2-42bc00dd166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9621635-c0cd-47d2-ba92-51a401474978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Volume 9ca7c67b-e422-41ed-ae9b-4cd017937151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca7c67b-e422-41ed-ae9b-4cd017937151', 'volume_size': 1} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Flow 'volume_create_manager' (27675e01-a471-4aa4-9f5d-2e0ee465ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5057e6ee-3fc3-42cd-a184-558177287072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5057e6ee-3fc3-42cd-a184-558177287072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1941220023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=485573c2-493a-429f-98f6-8bb57107e0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f313d0edf7e540e18bfd665830107cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b9702d4-fd95-4310-acc2-0aeee2d50269,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:05Z,use_quota=True,user_id='34a2b59d20594b429a5e44d3ec193990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2758b14e-db9e-4f3b-8b7b-c444824f7b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2758b14e-db9e-4f3b-8b7b-c444824f7b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4063c271-464a-4867-b235-a0d873c93925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4063c271-464a-4867-b235-a0d873c93925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '485573c2-493a-429f-98f6-8bb57107e0b3', 'volume_name': 'volume-485573c2-493a-429f-98f6-8bb57107e0b3', 'volume_size': 1, 'snapshot_id': '3b9702d4-fd95-4310-acc2-0aeee2d50269'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b114bf-2ff3-4489-b4c9-7d37f9f6ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b114bf-2ff3-4489-b4c9-7d37f9f6ca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cf781-0c4c-44e7-b71d-978d85e6f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Volume 485573c2-493a-429f-98f6-8bb57107e0b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-485573c2-493a-429f-98f6-8bb57107e0b3', 'volume_size': 1, 'snapshot_id': '3b9702d4-fd95-4310-acc2-0aeee2d50269'} Jul 30 16:46:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:05 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 1G" returned: 0 in 0.704s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44464c26-10c6-4d83-93eb-9a75f1954193 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:05 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44464c26-10c6-4d83-93eb-9a75f1954193 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 Jul 30 16:46:05 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:05 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44464c26-10c6-4d83-93eb-9a75f1954193 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" returned: 0 in 0.342s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:05 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 is being set with open permissions: ugo+rw Jul 30 16:46:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:05 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 Jul 30 16:46:05 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:05 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:05 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info Jul 30 16:46:05 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:06 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info" returned: 0 in 0.314s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:06 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info is being set with open permissions: ugo+rw Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:06 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info Jul 30 16:46:06 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:06 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.info" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6b623ea-78b9-4f62-b085-237af09848c7,created_at=2026-07-30T14:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-481075803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6b623ea-78b9-4f62-b085-237af09848c7,host='devstack@QuobyteHD#QuobyteHD',id=9ca7c67b-e422-41ed-ae9b-4cd017937151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb8f8065534f80908a373fb2221e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:04Z,use_quota=True,user_id='844a498c22104e9b98928e076ef005b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0799661-d6b3-461a-b78c-0cb1654cf428),volume_type_id=c0799661-d6b3-461a-b78c-0cb1654cf428)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Creating volume 9ca7c67b-e422-41ed-ae9b-4cd017937151 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:06 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:06 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 1073741824 Jul 30 16:46:06 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-944181f6-c579-48f9-9cec-ae3441f7546b tempest-VolumeDependencyTests-1771972531 None] Create snapshot completed successfully Jul 30 16:46:06 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 1073741824" returned: 0 in 0.602s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:07 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 Jul 30 16:46:07 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:07 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151" returned: 0 in 0.318s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.316s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-quobyte-3b9702d4-fd95-4310-acc2-0aeee2d50269-485573c2-493a-429f-98f6-8bb57107e0b3" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9621635-c0cd-47d2-ba92-51a401474978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca7c67b-e422-41ed-ae9b-4cd017937151', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073e32fe-9c40-4d25-9eb2-d01ad97a419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-3b9702d4-fd95-4310-acc2-0aeee2d50269-485573c2-493a-429f-98f6-8bb57107e0b3" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Creating volume 485573c2-493a-429f-98f6-8bb57107e0b3 from snapshot 3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-quobyte-485573c2-493a-429f-98f6-8bb57107e0b3" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Volume volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 (9ca7c67b-e422-41ed-ae9b-4cd017937151): created successfully Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073e32fe-9c40-4d25-9eb2-d01ad97a419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Flow 'volume_create_manager' (72ddf474-9a87-48d4-b1be-e54ca1ee27d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-485573c2-493a-429f-98f6-8bb57107e0b3" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] snapshot: 3b9702d4-fd95-4310-acc2-0aeee2d50269, volume: 485573c2-493a-429f-98f6-8bb57107e0b3, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:46:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-54d98a1c-bf10-4007-acdf-05b5e7adcbc8 tempest-GroupsTest-1401310802 None] Created volume successfully. Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bfb3d4-a976-43ae-bf6d-b7ec35942d59]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:07 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 Jul 30 16:46:07 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:08 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269" returned: 0 in 0.563s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21a857f-3f50-472d-9b4f-d502d008dd4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Flow 'volume_create_manager' (f43d8e2e-0524-481e-a457-07463acaaf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01082c71-53b0-4dcc-a2aa-a1642645db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8564657-cbef-4daa-898a-33f96211d4f9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01082c71-53b0-4dcc-a2aa-a1642645db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-388494234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4837c1c0-834e-410b-ab3c-83d482bdc76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29f28adf438745f294426f8320a73e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:08Z,use_quota=True,user_id='0898ae9d09e54a10b09cf2dc8919a49e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743e7f28-7a59-4e47-ab91-a9031a21c71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743e7f28-7a59-4e47-ab91-a9031a21c71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ecf601-7264-423f-a2e1-4154d7bf1a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ecf601-7264-423f-a2e1-4154d7bf1a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4837c1c0-834e-410b-ab3c-83d482bdc76a', 'volume_name': 'volume-4837c1c0-834e-410b-ab3c-83d482bdc76a', 'volume_size': 1, 'snapshot_id': 'f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:08 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d Jul 30 16:46:08 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264212c2-9cb4-4fdd-90fd-76848d1a8ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264212c2-9cb4-4fdd-90fd-76848d1a8ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c1edf-443e-4713-b095-c705520dca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Volume 4837c1c0-834e-410b-ab3c-83d482bdc76a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4837c1c0-834e-410b-ab3c-83d482bdc76a', 'volume_size': 1, 'snapshot_id': 'f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713'} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:08 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d" returned: 0 in 0.625s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:46:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:08 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 Jul 30 16:46:08 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Acquiring lock "cinder-quobyte-9ca7c67b-e422-41ed-ae9b-4cd017937151" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Lock "cinder-quobyte-9ca7c67b-e422-41ed-ae9b-4cd017937151" acquired by "delete_volume" :: waited 0.038s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7e5d9-a244-48b6-b147-05583b4a0201]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:09 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 Jul 30 16:46:09 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:10 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151" returned: 0 in 0.751s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:10 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151 Jul 30 16:46:10 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:11 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9ca7c67b-e422-41ed-ae9b-4cd017937151" returned: 0 in 1.019s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Lock "cinder-quobyte-9ca7c67b-e422-41ed-ae9b-4cd017937151" released by "delete_volume" :: held 1.886s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:11 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Created reservations ['b756e311-b4ad-499c-beb5-4b6b28347375'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:11 devstack cinder-volume[88380]: WARNING cinder.quota [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1273077495 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1273077495, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:46:11 devstack cinder-volume[88380]: WARNING cinder.quota [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1273077495 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1273077495, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:46:11 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Created reservations ['698747ca-c1c7-4fe2-ad27-009f951a6282', '6a9002b6-99df-4b97-91f0-2e3a59a482e0', '15ffd2ce-3411-4dae-9519-03e38dfb44d7', '7e5e071c-edd7-436b-b4c7-8aa4ffecb862'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:12 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:12 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:12 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.632s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:12 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-94260eda-3800-4f6b-8ef0-5f76f6954948 tempest-GroupsTest-1401310802 None] Delete group completed successfully. Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Created reservations ['e92a64ef-2b85-49f6-92cf-902af00c2bd5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:13 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:13 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 1.101s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:14 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e32ffe17-8ea5-4a76-b3bd-82f07310423a tempest-GroupsTest-1401310802 None] Delete group completed successfully. Jul 30 16:46:14 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:14 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=233,cinder:DELETE=13,cinder:SELECT=176,cinder:INSERT=54 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:46:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a2d5f134-8703-4f66-839e-8f18c940491f tempest-GroupsTest-1401310802 None] Group tempest-GroupsTest-Group-1399812473: creating Jul 30 16:46:14 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=204,cinder:INSERT=50,cinder:UPDATE=211,cinder:DELETE=16 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:46:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a2d5f134-8703-4f66-839e-8f18c940491f tempest-GroupsTest-1401310802 None] Group tempest-GroupsTest-Group-1399812473: created successfully Jul 30 16:46:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a2d5f134-8703-4f66-839e-8f18c940491f tempest-GroupsTest-1401310802 None] Create group completed successfully. Jul 30 16:46:16 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3" returned: 0 in 7.506s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d, size 1024.00 MB, duration 7.51 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:46:16 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Converted 1024.00 MB image at 136.41 MB/s Jul 30 16:46:16 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 is being set with open permissions: ugo+rw Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:16 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 Jul 30 16:46:16 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Flow 'volume_create_manager' (82793b0c-d13e-4d95-8803-3da9dd4c36da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf85ee-5eb2-4e9e-8891-eb3c33dde901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:16 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3" returned: 0 in 0.392s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf85ee-5eb2-4e9e-8891-eb3c33dde901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-318429014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7e352e-448a-4fcb-b070-5355967604dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a013492ba6154933bcf6f040fca6c454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:17Z,use_quota=True,user_id='be87badfbaf244d0b22fecea18dc00a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(299990af-cbe1-4d0d-a31b-6008acb33587),volume_type_id=299990af-cbe1-4d0d-a31b-6008acb33587)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24beaaee-4614-410b-8900-d05d166951db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24beaaee-4614-410b-8900-d05d166951db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc836dd5-730c-430c-adcb-dfd4ce4c41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc836dd5-730c-430c-adcb-dfd4ce4c41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7e352e-448a-4fcb-b070-5355967604dc', 'volume_name': 'volume-7e7e352e-448a-4fcb-b070-5355967604dc', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f002c7-a84f-449e-b309-505e1f15431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f002c7-a84f-449e-b309-505e1f15431b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0c190c-495d-42e9-87bb-35679be597b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:16 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Volume 7e7e352e-448a-4fcb-b070-5355967604dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7e352e-448a-4fcb-b070-5355967604dc', 'volume_size': 1} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-485573c2-493a-429f-98f6-8bb57107e0b3" released by "_copy_volume_from_snapshot" :: held 9.375s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-3b9702d4-fd95-4310-acc2-0aeee2d50269-485573c2-493a-429f-98f6-8bb57107e0b3" released by "_create_volume_from_snapshot" :: held 9.530s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.579s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.458s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-quobyte-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713-4837c1c0-834e-410b-ab3c-83d482bdc76a" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cf781-0c4c-44e7-b71d-978d85e6f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485573c2-493a-429f-98f6-8bb57107e0b3', 'volume_size': 1, 'snapshot_id': '3b9702d4-fd95-4310-acc2-0aeee2d50269'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7356fe-523f-48d6-86c7-486430b228de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713-4837c1c0-834e-410b-ab3c-83d482bdc76a" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Creating volume 4837c1c0-834e-410b-ab3c-83d482bdc76a from snapshot f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-quobyte-4837c1c0-834e-410b-ab3c-83d482bdc76a" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:16 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Volume volume-485573c2-493a-429f-98f6-8bb57107e0b3 (485573c2-493a-429f-98f6-8bb57107e0b3): created successfully Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7356fe-523f-48d6-86c7-486430b228de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Flow 'volume_create_manager' (27675e01-a471-4aa4-9f5d-2e0ee465ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-4837c1c0-834e-410b-ab3c-83d482bdc76a" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] snapshot: f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713, volume: 4837c1c0-834e-410b-ab3c-83d482bdc76a, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec8df62-30b4-4fb2-9fb0-5edad6f81711]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:17 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f2258eb4-130b-4f9e-933e-d77b7add3820 tempest-TestStampPattern-1707302050 None] Created volume successfully. Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Flow 'volume_create_manager' (7b785df4-a475-498a-a380-7486370bd047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129cda6b-8dd5-4ca2-9e80-8c1d323a2ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129cda6b-8dd5-4ca2-9e80-8c1d323a2ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601800070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c16d0451-ff78-4910-9476-cf375c99b919,host='devstack@QuobyteHD#QuobyteHD',id=931bf6c0-7179-42fa-9b14-ea5d22e74e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb8f8065534f80908a373fb2221e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:17Z,use_quota=True,user_id='844a498c22104e9b98928e076ef005b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac33e225-e66c-43f7-9805-c46a18d58c88),volume_type_id=ac33e225-e66c-43f7-9805-c46a18d58c88)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f76d50-5848-479c-b63b-487393f68a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f76d50-5848-479c-b63b-487393f68a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f30d37-bb33-4ec3-a46a-38733b6d749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f30d37-bb33-4ec3-a46a-38733b6d749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931bf6c0-7179-42fa-9b14-ea5d22e74e9d', 'volume_name': 'volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42556ccc-fd65-41e0-b3a1-6f6801628d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42556ccc-fd65-41e0-b3a1-6f6801628d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f6a1d1-6d28-405a-8370-329998745ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:17 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Volume 931bf6c0-7179-42fa-9b14-ea5d22e74e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d', 'volume_size': 1} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:17 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 Jul 30 16:46:17 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:17 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" returned: 0 in 0.446s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44464c26-10c6-4d83-93eb-9a75f1954193(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f334a1c2-c351-42ac-8433-96f1a80c0563]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:17 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 Jul 30 16:46:17 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:17 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193" returned: 0 in 0.389s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:46:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:18 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a Jul 30 16:46:18 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:24 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a" returned: 0 in 6.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:46:24 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Converted 1024.00 MB image at 163.72 MB/s Jul 30 16:46:24 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a is being set with open permissions: ugo+rw Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:24 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a Jul 30 16:46:24 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:24 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a" returned: 0 in 0.299s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-4837c1c0-834e-410b-ab3c-83d482bdc76a" released by "_copy_volume_from_snapshot" :: held 7.554s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713-4837c1c0-834e-410b-ab3c-83d482bdc76a" released by "_create_volume_from_snapshot" :: held 7.658s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.700s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.798s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-318429014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7e352e-448a-4fcb-b070-5355967604dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a013492ba6154933bcf6f040fca6c454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:17Z,use_quota=True,user_id='be87badfbaf244d0b22fecea18dc00a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(299990af-cbe1-4d0d-a31b-6008acb33587),volume_type_id=299990af-cbe1-4d0d-a31b-6008acb33587)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Creating volume 7e7e352e-448a-4fcb-b070-5355967604dc {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:24 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:24 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc 1073741824 Jul 30 16:46:24 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c1edf-443e-4713-b095-c705520dca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4837c1c0-834e-410b-ab3c-83d482bdc76a', 'volume_size': 1, 'snapshot_id': 'f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201c8f67-809b-4dfd-939f-932076e71103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:24 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Volume volume-4837c1c0-834e-410b-ab3c-83d482bdc76a (4837c1c0-834e-410b-ab3c-83d482bdc76a): created successfully Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201c8f67-809b-4dfd-939f-932076e71103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Flow 'volume_create_manager' (f43d8e2e-0524-481e-a457-07463acaaf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-46344c20-fb2e-4db7-b75a-5fdb414b93d8 tempest-VolumeDependencyTests-1771972531 None] Created volume successfully. Jul 30 16:46:25 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc 1073741824" returned: 0 in 0.567s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:25 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc Jul 30 16:46:25 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-quobyte-44464c26-10c6-4d83-93eb-9a75f1954193" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-44464c26-10c6-4d83-93eb-9a75f1954193" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-quobyte-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Deleting offline snapshot f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 of volume 44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] snapshot_file for this snap is: volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee87392-3194-4f1b-9402-5fc8c1b5ca11]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:25 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 Jul 30 16:46:25 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:25 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc" returned: 0 in 0.410s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.386s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c16d0451-ff78-4910-9476-cf375c99b919,created_at=2026-07-30T14:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-601800070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c16d0451-ff78-4910-9476-cf375c99b919,host='devstack@QuobyteHD#QuobyteHD',id=931bf6c0-7179-42fa-9b14-ea5d22e74e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb8f8065534f80908a373fb2221e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:17Z,use_quota=True,user_id='844a498c22104e9b98928e076ef005b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac33e225-e66c-43f7-9805-c46a18d58c88),volume_type_id=ac33e225-e66c-43f7-9805-c46a18d58c88)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Creating volume 931bf6c0-7179-42fa-9b14-ea5d22e74e9d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:25 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:25 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d 1073741824 Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0c190c-495d-42e9-87bb-35679be597b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7e352e-448a-4fcb-b070-5355967604dc', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd48ef-afa9-4e7d-9bf3-4c1fb8061433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:25 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Volume volume-7e7e352e-448a-4fcb-b070-5355967604dc (7e7e352e-448a-4fcb-b070-5355967604dc): created successfully Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cd48ef-afa9-4e7d-9bf3-4c1fb8061433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Flow 'volume_create_manager' (82793b0c-d13e-4d95-8803-3da9dd4c36da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e4b3a3d3-5c26-4ad1-9105-abf7a013c7e2 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Created volume successfully. Jul 30 16:46:25 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" returned: 0 in 0.423s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44464c26-10c6-4d83-93eb-9a75f1954193(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f81a8fd-897c-4f71-9ca3-614e6772ec3b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:26 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 Jul 30 16:46:26 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:26 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d 1073741824" returned: 0 in 0.481s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:26 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d Jul 30 16:46:26 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:26 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193" returned: 0 in 0.586s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:26 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:26 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 Jul 30 16:46:26 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f6a1d1-6d28-405a-8370-329998745ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daeb50d0-469a-4907-80e4-548fc7c25587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:26 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Volume volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d (931bf6c0-7179-42fa-9b14-ea5d22e74e9d): created successfully Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daeb50d0-469a-4907-80e4-548fc7c25587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Flow 'volume_create_manager' (7b785df4-a475-498a-a380-7486370bd047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ebb0af41-74d2-4e26-beb8-ed8430197471 tempest-GroupsTest-1401310802 None] Created volume successfully. Jul 30 16:46:26 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" returned: 0 in 0.426s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:26 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713 Jul 30 16:46:26 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:27 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:27 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:27 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193.f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713" released by "_delete_snapshot" :: held 1.858s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-44464c26-10c6-4d83-93eb-9a75f1954193" released by "delete_snapshot" :: held 1.883s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Created reservations ['de2f9ddd-4e41-49cb-ad46-ac88e93192b6', 'a51fd81b-fa82-4c1c-a520-7c0d93765afe', 'e4ed6000-11ce-42ad-83fa-fd8028be5797', 'a8b90ecc-aed0-4a00-9007-19cc5ecf87fb'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Delete snapshot completed successfully. Jul 30 16:46:27 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-35087c13-c608-46f3-b80d-7474421758e2 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-f3f30c0a-5baf-4f9b-bbf6-c2ae4f8a2713-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f990a2c6-c85f-431e-bc4f-126e8224f13a tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Retype volume completed successfully. Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-44464c26-10c6-4d83-93eb-9a75f1954193-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-44464c26-10c6-4d83-93eb-9a75f1954193-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-quobyte-44464c26-10c6-4d83-93eb-9a75f1954193" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-44464c26-10c6-4d83-93eb-9a75f1954193" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2b4169-91fe-4e4d-bfd4-7ec70f4ce70c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:27 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 Jul 30 16:46:27 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:28 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193" returned: 0 in 0.452s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193 Jul 30 16:46:28 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Acquiring lock "cinder-7e7e352e-448a-4fcb-b070-5355967604dc-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "cinder-7e7e352e-448a-4fcb-b070-5355967604dc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Flow 'volume_create_manager' (79e4de81-20b4-48cf-883c-d1157243c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22795820-42c5-4c33-9d92-d4efad2691eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22795820-42c5-4c33-9d92-d4efad2691eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-799585067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c16d0451-ff78-4910-9476-cf375c99b919,host='devstack@QuobyteHD#QuobyteHD',id=ca92530b-1753-4470-9543-b553de9ee7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb8f8065534f80908a373fb2221e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:28Z,use_quota=True,user_id='844a498c22104e9b98928e076ef005b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac33e225-e66c-43f7-9805-c46a18d58c88),volume_type_id=ac33e225-e66c-43f7-9805-c46a18d58c88)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3413664d-19a2-4205-9060-6c865f177176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3413664d-19a2-4205-9060-6c865f177176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8b8daa-fa67-47fb-9255-4fe089448104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8b8daa-fa67-47fb-9255-4fe089448104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca92530b-1753-4470-9543-b553de9ee7c3', 'volume_name': 'volume-ca92530b-1753-4470-9543-b553de9ee7c3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0adddb-ccc7-4975-9505-206f068d3aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0adddb-ccc7-4975-9505-206f068d3aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26055df-4e83-41b3-80bc-44660e4af002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:28 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Volume ca92530b-1753-4470-9543-b553de9ee7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca92530b-1753-4470-9543-b553de9ee7c3', 'volume_size': 1} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c16d0451-ff78-4910-9476-cf375c99b919,created_at=2026-07-30T14:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-799585067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c16d0451-ff78-4910-9476-cf375c99b919,host='devstack@QuobyteHD#QuobyteHD',id=ca92530b-1753-4470-9543-b553de9ee7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb8f8065534f80908a373fb2221e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:28Z,use_quota=True,user_id='844a498c22104e9b98928e076ef005b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac33e225-e66c-43f7-9805-c46a18d58c88),volume_type_id=ac33e225-e66c-43f7-9805-c46a18d58c88)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Creating volume ca92530b-1753-4470-9543-b553de9ee7c3 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:28 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-44464c26-10c6-4d83-93eb-9a75f1954193" returned: 0 in 0.625s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:28 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 1073741824 Jul 30 16:46:28 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-44464c26-10c6-4d83-93eb-9a75f1954193" released by "delete_volume" :: held 1.153s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Acquiring lock "cinder-quobyte-7e7e352e-448a-4fcb-b070-5355967604dc" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "cinder-quobyte-7e7e352e-448a-4fcb-b070-5355967604dc" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6d8ae-a424-49e0-b84d-07105a2a608e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Created reservations ['0e18ea73-1887-40ec-a6c6-a26877895458', '584822ae-8eba-4364-a53d-aacc213af88f', 'db3a8730-0809-4cad-8c39-771f4e9d1949', '5876f1e7-2ffc-4f44-87c9-4a6d3770e67d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:29 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc Jul 30 16:46:29 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 1073741824" returned: 0 in 0.517s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.328s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Deleted volume successfully. Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-55e0c275-7ac9-4eb8-a6c9-3c520f5d9a8c tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-44464c26-10c6-4d83-93eb-9a75f1954193-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:29 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 Jul 30 16:46:29 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc" returned: 0 in 0.539s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc Jul 30 16:46:29 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3" returned: 0 in 0.334s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:29 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26055df-4e83-41b3-80bc-44660e4af002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca92530b-1753-4470-9543-b553de9ee7c3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6988cad-f6db-43fa-90d0-42be95a548c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7e7e352e-448a-4fcb-b070-5355967604dc" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "cinder-quobyte-7e7e352e-448a-4fcb-b070-5355967604dc" released by "delete_volume" :: held 0.930s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:29 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Volume volume-ca92530b-1753-4470-9543-b553de9ee7c3 (ca92530b-1753-4470-9543-b553de9ee7c3): created successfully Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6988cad-f6db-43fa-90d0-42be95a548c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Flow 'volume_create_manager' (79e4de81-20b4-48cf-883c-d1157243c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b49eda1f-3ccb-4c31-9fe8-0ace6a19dbe7 tempest-GroupsTest-1401310802 None] Created volume successfully. Jul 30 16:46:29 devstack cinder-volume[88380]: WARNING cinder.quota [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:46:29 devstack cinder-volume[88380]: WARNING cinder.quota [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Created reservations ['978313ea-3525-4147-b47b-12a3ddc10824', '769facda-2e2f-4a4a-a343-24ef3e938e34', '58c25d79-4f8d-4d4d-8457-688282525b38', '87379813-4ef8-49e2-90be-d7b2e7cfa19d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-4837c1c0-834e-410b-ab3c-83d482bdc76a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-4837c1c0-834e-410b-ab3c-83d482bdc76a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "cinder-quobyte-4837c1c0-834e-410b-ab3c-83d482bdc76a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:29 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:29 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-4837c1c0-834e-410b-ab3c-83d482bdc76a" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[974dcc30-a693-41f0-ac49-9dadb1df8f05]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a Jul 30 16:46:30 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.277s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:30 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Deleted volume successfully. Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-054e5190-9968-41f3-8048-312c876ae324 tempest-VolumeRetypeWithoutMigrationTest-892610880 None] Lock "cinder-7e7e352e-448a-4fcb-b070-5355967604dc-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:30 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a" returned: 0 in 0.366s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a Jul 30 16:46:30 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:30 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4837c1c0-834e-410b-ab3c-83d482bdc76a" returned: 0 in 0.243s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-quobyte-4837c1c0-834e-410b-ab3c-83d482bdc76a" released by "delete_volume" :: held 0.664s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Created reservations ['4fe6ccd1-f8cc-46c3-b2ed-8b0ab6378385', '2328fb0a-190d-4ec6-98ce-d64f670c5457', 'd68feccc-c97b-44d1-8ebf-396253eee9e4', '8da6be78-7765-4207-96ad-cfc0b153b9fa'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:30 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:30 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:31 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:31 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Deleted volume successfully. Jul 30 16:46:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7d03605c-00ce-4fde-aa90-7ac9bcdede75 tempest-VolumeDependencyTests-1771972531 None] Lock "cinder-4837c1c0-834e-410b-ab3c-83d482bdc76a-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c8aa0b53-7376-45a3-9c51-6a8d6a8dcdcc tempest-GroupsTest-1401310802 None] Update group completed successfully. Jul 30 16:46:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-413ae47b-8947-4642-9461-3a21f8da3e97 tempest-GroupsTest-1401310802 None] Update group completed successfully. Jul 30 16:46:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Acquiring lock "cinder-quobyte-931bf6c0-7179-42fa-9b14-ea5d22e74e9d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Lock "cinder-quobyte-931bf6c0-7179-42fa-9b14-ea5d22e74e9d" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b7184-ecfc-4422-bcdb-72bd0b9f3425]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d Jul 30 16:46:34 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:34 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d" returned: 0 in 0.462s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:34 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d Jul 30 16:46:34 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-931bf6c0-7179-42fa-9b14-ea5d22e74e9d" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Lock "cinder-quobyte-931bf6c0-7179-42fa-9b14-ea5d22e74e9d" released by "delete_volume" :: held 0.789s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Acquiring lock "cinder-quobyte-ca92530b-1753-4470-9543-b553de9ee7c3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Lock "cinder-quobyte-ca92530b-1753-4470-9543-b553de9ee7c3" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0679f-2719-4783-9781-0e14217961af]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 Jul 30 16:46:35 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3" returned: 0 in 0.438s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:35 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3 Jul 30 16:46:35 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:35 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ca92530b-1753-4470-9543-b553de9ee7c3" returned: 0 in 0.275s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Lock "cinder-quobyte-ca92530b-1753-4470-9543-b553de9ee7c3" released by "delete_volume" :: held 0.758s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Created reservations ['e10594e0-3055-4099-b2a4-e0a5d7b3efa8'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:36 devstack cinder-volume[88380]: WARNING cinder.quota [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-832506651 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-832506651, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:46:36 devstack cinder-volume[88380]: WARNING cinder.quota [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-832506651 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-832506651, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Created reservations ['456e08a0-cfe6-4b79-9efa-e9952a27e4e9', '76910e55-2a27-4d01-954b-bbd4b2e1c1ec', '2e1a730e-78fe-417e-837a-25b769588962', 'b1557aaf-d462-40e9-99e2-40bce0783a96'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Created reservations ['84fe10ad-738f-4d03-972a-e6bce65cbd91', '68d7b90a-04e5-4ae7-bb1c-7c1f6f82711c', '091ea2b5-366f-46d3-aeb8-1baecdc4aab2', 'e2f67321-eb35-47bd-87d2-5a0134aa2cbf'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:36 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:36 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:36 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:36 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5855992b-ecdf-433e-822c-a35fd923497a tempest-GroupsTest-1401310802 None] Delete group completed successfully. Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Flow 'volume_create_manager' (b0bea60b-5d09-4ced-b8cc-3edee00d47a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c50b3cd-56d9-486d-ad04-734a51ee3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c50b3cd-56d9-486d-ad04-734a51ee3184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9de1a0-c8b5-4d27-a497-f97b06fbc478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd4e6ef0fe34356884d4c860c612ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:38Z,use_quota=True,user_id='4048e23f80734adbaffd0a94845c56b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e34db7-9614-4e36-8d60-df214a25a4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e34db7-9614-4e36-8d60-df214a25a4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cc5bfc-3a03-409c-86d1-3658e9b9f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:37 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cc5bfc-3a03-409c-86d1-3658e9b9f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f9de1a0-c8b5-4d27-a497-f97b06fbc478', 'volume_name': 'volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478', 'volume_size': 1, 'image_id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7615bee658d3f4ba131a73dc39265956', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efd4e6ef0fe34356884d4c860c612ec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da6a35c3eb26038c112dca8103a313ee0a9278eb6625e05021478eb4ca5b37a685c8c510b9e887d3b93aff9b97c1082f60c990c51efa1eb4197ad299a4f7c838', 'id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4/file', 'properties': {}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2188d92e-8645-4e64-ba61-42bc1b737436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2188d92e-8645-4e64-ba61-42bc1b737436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c8fd15-667a-40c0-84a2-a41e2364825f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Volume 9f9de1a0-c8b5-4d27-a497-f97b06fbc478: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478', 'volume_size': 1, 'image_id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7615bee658d3f4ba131a73dc39265956', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efd4e6ef0fe34356884d4c860c612ec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da6a35c3eb26038c112dca8103a313ee0a9278eb6625e05021478eb4ca5b37a685c8c510b9e887d3b93aff9b97c1082f60c990c51efa1eb4197ad299a4f7c838', 'id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4/file', 'properties': {}}, 'image_service': } Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Trying to clone 9f9de1a0-c8b5-4d27-a497-f97b06fbc478 from image 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:46:38 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f73df-4ee1-44e0-8044-45936d0e90ab]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD Jul 30 16:46:39 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD Jul 30 16:46:39 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:39 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Temporary image 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 is fetched for user 4048e23f80734adbaffd0a94845c56b3. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca20da7-6506-4328-b1b5-a71ff6caf339]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:39 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD Jul 30 16:46:39 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:40 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:40 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD Jul 30 16:46:40 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:40 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9de1a0-c8b5-4d27-a497-f97b06fbc478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd4e6ef0fe34356884d4c860c612ec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:38Z,use_quota=True,user_id='4048e23f80734adbaffd0a94845c56b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Creating volume 9f9de1a0-c8b5-4d27-a497-f97b06fbc478 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:40 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:40 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 1073741824 Jul 30 16:46:40 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:41 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 1073741824" returned: 0 in 0.561s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:41 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 Jul 30 16:46:41 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:41 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" returned: 0 in 0.279s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Attempting download of 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'metadata': {}}])) to volume 9f9de1a0-c8b5-4d27-a497-f97b06fbc478. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73260ef-b8e6-4a79-b9c0-a24509b98004]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:41 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5 Jul 30 16:46:41 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:41 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5" returned: 0 in 0.380s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:41 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5 Jul 30 16:46:41 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:42 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5" returned: 1 in 0.434s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_02oe8on5' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:42 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b999c9-3963-4e3b-8e3f-b381fe573022]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:42 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD Jul 30 16:46:42 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:42 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:42 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD Jul 30 16:46:42 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:43 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 was raw, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:43 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 Jul 30 16:46:43 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Flow 'volume_create_manager' (3275d804-4a69-4bb8-807b-329522eed4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdbefcc-d3b6-4b9e-8c40-7b00e6bf2940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdbefcc-d3b6-4b9e-8c40-7b00e6bf2940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1778476595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb1367c-0a25-438f-a919-ee013aa5e38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bbe8a1ac0d429cb3bdaf6f2fd34475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:43Z,use_quota=True,user_id='d7bb8d18c5304dad877683f4027b42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9be57f-5251-4659-91e1-ddd8dd8026a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9be57f-5251-4659-91e1-ddd8dd8026a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c17a64-29cb-4418-809a-9c5fb995d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c17a64-29cb-4418-809a-9c5fb995d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb1367c-0a25-438f-a919-ee013aa5e38f', 'volume_name': 'volume-1eb1367c-0a25-438f-a919-ee013aa5e38f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86342260-dd80-4c26-add1-338802a65095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86342260-dd80-4c26-add1-338802a65095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f4ef75-22dd-450d-a91e-a7418ac451d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Volume 1eb1367c-0a25-438f-a919-ee013aa5e38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb1367c-0a25-438f-a919-ee013aa5e38f', 'volume_size': 1} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1778476595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb1367c-0a25-438f-a919-ee013aa5e38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bbe8a1ac0d429cb3bdaf6f2fd34475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:43Z,use_quota=True,user_id='d7bb8d18c5304dad877683f4027b42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Creating volume 1eb1367c-0a25-438f-a919-ee013aa5e38f {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:43 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:43 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f 1073741824 Jul 30 16:46:43 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:43 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" returned: 0 in 0.630s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7fbfff56-eb4c-4918-908d-0cc8a72ed0c4_k299aizwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:46:43 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:43 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 1G Jul 30 16:46:43 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:43 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f 1073741824" returned: 0 in 0.621s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:44 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f Jul 30 16:46:44 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:44 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 1G" returned: 0 in 0.474s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Downloaded image 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'metadata': {}}])) to volume 9f9de1a0-c8b5-4d27-a497-f97b06fbc478 successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Temporary image 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 for user 4048e23f80734adbaffd0a94845c56b3 is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Marking volume 9f9de1a0-c8b5-4d27-a497-f97b06fbc478 as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Copying metadata from image 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 to 9f9de1a0-c8b5-4d27-a497-f97b06fbc478. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Creating volume glance metadata for volume 9f9de1a0-c8b5-4d27-a497-f97b06fbc478 backed by image 7fbfff56-eb4c-4918-908d-0cc8a72ed0c4 with: {'image_id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7615bee658d3f4ba131a73dc39265956', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c8fd15-667a-40c0-84a2-a41e2364825f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478', 'volume_size': 1, 'image_id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7615bee658d3f4ba131a73dc39265956', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'efd4e6ef0fe34356884d4c860c612ec9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da6a35c3eb26038c112dca8103a313ee0a9278eb6625e05021478eb4ca5b37a685c8c510b9e887d3b93aff9b97c1082f60c990c51efa1eb4197ad299a4f7c838', 'id': '7fbfff56-eb4c-4918-908d-0cc8a72ed0c4', 'created_at': datetime.datetime(2026, 7, 30, 14, 46, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 46, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7fbfff56-eb4c-4918-908d-0cc8a72ed0c4/file', 'properties': {}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef0990b-bda4-4488-aead-723c295fbb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Volume volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 (9f9de1a0-c8b5-4d27-a497-f97b06fbc478): created successfully Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef0990b-bda4-4488-aead-723c295fbb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Flow 'volume_create_manager' (b0bea60b-5d09-4ced-b8cc-3edee00d47a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f" returned: 0 in 0.417s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d5f53e8-9071-4a71-bfde-030c21abdee8 tempest-GroupsV320Test-14324437 None] Group tempest-GroupsV320Test-Group-1360828629: creating Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-76e94753-00ea-4615-a1d5-9faee4e9178b tempest-VolumeImageDependencyTests-1789885084 None] Created volume successfully. Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f4ef75-22dd-450d-a91e-a7418ac451d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb1367c-0a25-438f-a919-ee013aa5e38f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9e2340-2def-4aa5-978e-5960ccb3cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Volume volume-1eb1367c-0a25-438f-a919-ee013aa5e38f (1eb1367c-0a25-438f-a919-ee013aa5e38f): created successfully Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9e2340-2def-4aa5-978e-5960ccb3cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Flow 'volume_create_manager' (3275d804-4a69-4bb8-807b-329522eed4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d5f53e8-9071-4a71-bfde-030c21abdee8 tempest-GroupsV320Test-14324437 None] Group tempest-GroupsV320Test-Group-1360828629: created successfully Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d5f53e8-9071-4a71-bfde-030c21abdee8 tempest-GroupsV320Test-14324437 None] Create group completed successfully. Jul 30 16:46:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2be60df3-820a-4161-9b10-3e0b277cb53b tempest-VolumesListAdminTestJSON-564616869 None] Created volume successfully. Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-e761aced-8d88-4126-baee-4c093ddd834e req-ca2e7393-25fe-42bc-92bd-7ed56d4438c2 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-e761aced-8d88-4126-baee-4c093ddd834e req-ca2e7393-25fe-42bc-92bd-7ed56d4438c2 tempest-TestStampPattern-1707302050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-e761aced-8d88-4126-baee-4c093ddd834e req-ca2e7393-25fe-42bc-92bd-7ed56d4438c2 tempest-TestStampPattern-1707302050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-e761aced-8d88-4126-baee-4c093ddd834e req-ca2e7393-25fe-42bc-92bd-7ed56d4438c2 tempest-TestStampPattern-1707302050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-485573c2-493a-429f-98f6-8bb57107e0b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b98731b-d780-46aa-b546-c945bd7720aa', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:46:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-e761aced-8d88-4126-baee-4c093ddd834e req-ca2e7393-25fe-42bc-92bd-7ed56d4438c2 tempest-TestStampPattern-1707302050 None] attachment_update completed successfully. Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Acquiring lock "cinder-9f9de1a0-c8b5-4d27-a497-f97b06fbc478-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Lock "cinder-9f9de1a0-c8b5-4d27-a497-f97b06fbc478-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:45 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Flow 'volume_create_manager' (4edbd615-c088-4dc3-b95e-917d50aa2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168defee-9c8e-470d-a77f-6d9a61203e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168defee-9c8e-470d-a77f-6d9a61203e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2126347451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6f63dd-40ab-4004-b9eb-4c2e660be55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bbe8a1ac0d429cb3bdaf6f2fd34475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:46Z,use_quota=True,user_id='d7bb8d18c5304dad877683f4027b42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21dc903-c910-4a7f-8676-b76802e5f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21dc903-c910-4a7f-8676-b76802e5f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c77f0-b46b-4926-8ad7-80584f29fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989c77f0-b46b-4926-8ad7-80584f29fb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6f63dd-40ab-4004-b9eb-4c2e660be55f', 'volume_name': 'volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911f8261-be81-435f-a6e0-3566a672a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911f8261-be81-435f-a6e0-3566a672a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9577dc-84dd-4dca-8f69-df1558238300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Volume 1e6f63dd-40ab-4004-b9eb-4c2e660be55f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f', 'volume_size': 1} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2126347451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6f63dd-40ab-4004-b9eb-4c2e660be55f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bbe8a1ac0d429cb3bdaf6f2fd34475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:46Z,use_quota=True,user_id='d7bb8d18c5304dad877683f4027b42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Creating volume 1e6f63dd-40ab-4004-b9eb-4c2e660be55f {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:46 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Acquiring lock "cinder-quobyte-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:46 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f 1073741824 Jul 30 16:46:46 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Lock "cinder-quobyte-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e1134e-250b-4a67-ace8-980bbcd76788]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Created reservations ['93321cb2-a671-4942-bfe4-a6a53e313874'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:46 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 Jul 30 16:46:46 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:46 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f 1073741824" returned: 0 in 0.678s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" returned: 0 in 0.601s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478 Jul 30 16:46:46 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:46 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.398s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:46 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-82c8c04f-3edb-4dcb-b261-84bb7af1fcbe tempest-GroupsV320Test-14324437 None] Delete group completed successfully. Jul 30 16:46:46 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f Jul 30 16:46:46 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" returned: 0 in 0.282s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Lock "cinder-quobyte-9f9de1a0-c8b5-4d27-a497-f97b06fbc478" released by "delete_volume" :: held 0.933s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:47 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af9577dc-84dd-4dca-8f69-df1558238300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e2c401-79e4-415d-a225-494b1065cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Volume volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f (1e6f63dd-40ab-4004-b9eb-4c2e660be55f): created successfully Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e2c401-79e4-415d-a225-494b1065cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Flow 'volume_create_manager' (4edbd615-c088-4dc3-b95e-917d50aa2500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7f646603-8304-4199-ab30-8d20873a4ede tempest-VolumesListAdminTestJSON-564616869 None] Created volume successfully. Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Created reservations ['c186f7cf-341d-4f45-9c9b-b2e6af756b78', 'be83d9f6-1faa-4b9a-bc15-4489a06475eb', '387af5d8-fb62-4b2f-9af4-65e84bb44d49', '7303ae40-2c63-4307-a957-e23fce149243'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:47 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:47 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:47 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.250s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Deleted volume successfully. Jul 30 16:46:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b339f120-49b8-48d9-b0fd-cae137251641 tempest-VolumeImageDependencyTests-1789885084 None] Lock "cinder-9f9de1a0-c8b5-4d27-a497-f97b06fbc478-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Flow 'volume_create_manager' (4156dfa0-cbbd-418a-ae2f-d0043f056998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f323665d-610a-4dc4-86ce-dd2c70069daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f323665d-610a-4dc4-86ce-dd2c70069daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-760247016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495deaaa-7df3-4b77-a741-db0d6a443a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bbe8a1ac0d429cb3bdaf6f2fd34475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='d7bb8d18c5304dad877683f4027b42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe236ab-d39f-4110-939c-b30cb41dd445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe236ab-d39f-4110-939c-b30cb41dd445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484bd2a5-776f-42bb-acca-6e840aae7139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484bd2a5-776f-42bb-acca-6e840aae7139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495deaaa-7df3-4b77-a741-db0d6a443a24', 'volume_name': 'volume-495deaaa-7df3-4b77-a741-db0d6a443a24', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc3cf66-e923-42d1-b960-ae9d4a348d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc3cf66-e923-42d1-b960-ae9d4a348d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c082b-332a-45dc-8d7e-e0ac321004b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:48 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Volume 495deaaa-7df3-4b77-a741-db0d6a443a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495deaaa-7df3-4b77-a741-db0d6a443a24', 'volume_size': 1} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-760247016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495deaaa-7df3-4b77-a741-db0d6a443a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9bbe8a1ac0d429cb3bdaf6f2fd34475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:49Z,use_quota=True,user_id='d7bb8d18c5304dad877683f4027b42eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Creating volume 495deaaa-7df3-4b77-a741-db0d6a443a24 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:48 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:48 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 1073741824 Jul 30 16:46:48 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-81a250c7-4aac-4d93-b592-6a3234a64484 req-03779071-07a9-43c1-a497-c8d0e716cca3 tempest-TestStampPattern-1707302050 None] Terminate volume connection completed successfully. Jul 30 16:46:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-81a250c7-4aac-4d93-b592-6a3234a64484 req-03779071-07a9-43c1-a497-c8d0e716cca3 tempest-TestStampPattern-1707302050 None] Deleting attachment 3b98731b-d780-46aa-b546-c945bd7720aa. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:46:49 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 1073741824" returned: 0 in 0.644s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:49 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 Jul 30 16:46:49 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:49 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8c082b-332a-45dc-8d7e-e0ac321004b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495deaaa-7df3-4b77-a741-db0d6a443a24', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1197a5c-b01c-4aec-b7e4-a6c2d388851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:50 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Volume volume-495deaaa-7df3-4b77-a741-db0d6a443a24 (495deaaa-7df3-4b77-a741-db0d6a443a24): created successfully Jul 30 16:46:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1197a5c-b01c-4aec-b7e4-a6c2d388851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Flow 'volume_create_manager' (4156dfa0-cbbd-418a-ae2f-d0043f056998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fc7be2fc-f5db-4971-9e0c-b84c893aad71 tempest-VolumesListAdminTestJSON-564616869 None] Created volume successfully. Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Flow 'volume_create_manager' (bc20e60f-b984-4bab-9793-81a14c5b2bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518d6469-69ab-405d-b74d-f2e972d2eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518d6469-69ab-405d-b74d-f2e972d2eb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e931f62-026b-44e0-9614-a294f15a4b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27489a9fa0d44a6f9730b67bfbd0ba1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:52Z,use_quota=True,user_id='aa8651103fbf4403aa02fd442831ff1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746e847e-6f16-4b9f-bceb-00c8ff647912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746e847e-6f16-4b9f-bceb-00c8ff647912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdb96a6-0f3a-4213-98e1-fe87adcf00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdb96a6-0f3a-4213-98e1-fe87adcf00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e931f62-026b-44e0-9614-a294f15a4b8a', 'volume_name': 'volume-0e931f62-026b-44e0-9614-a294f15a4b8a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0e347c-4f36-4776-ac0f-8cc0bd68b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0e347c-4f36-4776-ac0f-8cc0bd68b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1b51e4-5b25-4b5a-a6fb-426c92622ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:52 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Volume 0e931f62-026b-44e0-9614-a294f15a4b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e931f62-026b-44e0-9614-a294f15a4b8a', 'volume_size': 1} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e931f62-026b-44e0-9614-a294f15a4b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27489a9fa0d44a6f9730b67bfbd0ba1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:52Z,use_quota=True,user_id='aa8651103fbf4403aa02fd442831ff1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Creating volume 0e931f62-026b-44e0-9614-a294f15a4b8a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:52 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:52 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a 1073741824 Jul 30 16:46:52 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a 1073741824" returned: 0 in 0.710s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a Jul 30 16:46:53 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Flow 'volume_create_manager' (2ee46280-be4e-43ab-8b7d-63be58a5c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7282c3a0-1118-4fb3-8d5d-a213d722d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7282c3a0-1118-4fb3-8d5d-a213d722d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac74c4e-f7a5-4311-a082-d662e9cde8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239167bc15bd48eb955af9b08125fa01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:53Z,use_quota=True,user_id='82e7613c2ffe46f68202c55f2ff7da08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cfc9fc-33d1-4fc6-b8b3-2d5c4171286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cfc9fc-33d1-4fc6-b8b3-2d5c4171286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943c5fdb-57a6-46ad-9f84-9c9b06d17771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943c5fdb-57a6-46ad-9f84-9c9b06d17771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac74c4e-f7a5-4311-a082-d662e9cde8a3', 'volume_name': 'volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35d8fa3-5579-436b-9caa-87af1377aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35d8fa3-5579-436b-9caa-87af1377aefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd8828b-99f8-4d94-b3d0-a9986a6fa3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Volume dac74c4e-f7a5-4311-a082-d662e9cde8a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3', 'volume_size': 1} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:53 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac74c4e-f7a5-4311-a082-d662e9cde8a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239167bc15bd48eb955af9b08125fa01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:53Z,use_quota=True,user_id='82e7613c2ffe46f68202c55f2ff7da08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Creating volume dac74c4e-f7a5-4311-a082-d662e9cde8a3 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:53 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:53 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 1073741824 Jul 30 16:46:53 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1b51e4-5b25-4b5a-a6fb-426c92622ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e931f62-026b-44e0-9614-a294f15a4b8a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dca76a0-dfe8-4e71-9cb0-e0cc610e8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Volume volume-0e931f62-026b-44e0-9614-a294f15a4b8a (0e931f62-026b-44e0-9614-a294f15a4b8a): created successfully Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dca76a0-dfe8-4e71-9cb0-e0cc610e8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Flow 'volume_create_manager' (bc20e60f-b984-4bab-9793-81a14c5b2bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:53 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4c15cbcb-f48a-46b8-a8bc-f54abfab0ea1 tempest-VolumesListAdminTestJSON-1115881256 None] Created volume successfully. Jul 30 16:46:54 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 1073741824" returned: 0 in 0.499s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 Jul 30 16:46:54 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-485573c2-493a-429f-98f6-8bb57107e0b3-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd8828b-99f8-4d94-b3d0-a9986a6fa3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e19f26-6175-444a-b4f3-5f8535993b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Lock "cinder-485573c2-493a-429f-98f6-8bb57107e0b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Volume volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 (dac74c4e-f7a5-4311-a082-d662e9cde8a3): created successfully Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e19f26-6175-444a-b4f3-5f8535993b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Flow 'volume_create_manager' (2ee46280-be4e-43ab-8b7d-63be58a5c908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9ad4faba-bd48-43cf-89e1-baad53634091 tempest-CinderUnicodeTest-1869894617 None] Created volume successfully. Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Acquiring lock "cinder-0e931f62-026b-44e0-9614-a294f15a4b8a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-quobyte-485573c2-493a-429f-98f6-8bb57107e0b3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Lock "cinder-0e931f62-026b-44e0-9614-a294f15a4b8a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-485573c2-493a-429f-98f6-8bb57107e0b3" acquired by "delete_volume" :: waited 0.038s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Acquiring lock "cinder-quobyte-0e931f62-026b-44e0-9614-a294f15a4b8a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aba831-79cc-48eb-9d2c-28bbf4119e9d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Lock "cinder-quobyte-0e931f62-026b-44e0-9614-a294f15a4b8a" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "cinder-495deaaa-7df3-4b77-a741-db0d6a443a24-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcae158-65eb-4fc7-9cf0-32b39743cea0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-495deaaa-7df3-4b77-a741-db0d6a443a24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 Jul 30 16:46:54 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:54 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "cinder-quobyte-495deaaa-7df3-4b77-a741-db0d6a443a24" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:54 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a Jul 30 16:46:54 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-quobyte-495deaaa-7df3-4b77-a741-db0d6a443a24" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7590e6a4-d423-4b2a-a794-e532b556b47d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:54 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 Jul 30 16:46:54 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.378s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:55 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a" returned: 0 in 0.467s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a Jul 30 16:46:55 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3" returned: 0 in 0.634s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3 Jul 30 16:46:55 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e931f62-026b-44e0-9614-a294f15a4b8a" returned: 0 in 0.359s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Lock "cinder-quobyte-0e931f62-026b-44e0-9614-a294f15a4b8a" released by "delete_volume" :: held 0.909s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:55 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24" returned: 0 in 0.754s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Created reservations ['4a7fdfc9-ad9b-43f4-8636-d9cc29b02e06', 'cb38fbcc-6b5b-4b65-8fce-d13ac20aa704', '03e1f9b8-2854-4caa-b02e-35fcc63b5879', 'ccb5ffc3-53b5-4775-af6a-f56b8c6d04ea'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:55 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:55 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24 Jul 30 16:46:55 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Flow 'volume_create_manager' (3dd9b271-4fa9-46b4-9b25-0e1d5ef8dda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db1632e-0482-4bf7-bc67-84b28469c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-485573c2-493a-429f-98f6-8bb57107e0b3" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db1632e-0482-4bf7-bc67-84b28469c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-486413879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da44378-62eb-494f-a5a7-8c1e328156d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff48dbdbf2e4443b9feb8ed00152e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:55Z,use_quota=True,user_id='6dddfc31965d467bbc3851713859ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d65cf-9c95-49fb-9fd6-cadee3676b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970d65cf-9c95-49fb-9fd6-cadee3676b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd537d77-df11-4e7d-b23f-004f41b51c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd537d77-df11-4e7d-b23f-004f41b51c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da44378-62eb-494f-a5a7-8c1e328156d2', 'volume_name': 'volume-5da44378-62eb-494f-a5a7-8c1e328156d2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bb49e4-d0e9-4857-974e-9110044a7ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bb49e4-d0e9-4857-974e-9110044a7ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b360327b-7296-4e03-8014-985d814ac524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:55 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Volume 5da44378-62eb-494f-a5a7-8c1e328156d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da44378-62eb-494f-a5a7-8c1e328156d2', 'volume_size': 1} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-486413879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da44378-62eb-494f-a5a7-8c1e328156d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ff48dbdbf2e4443b9feb8ed00152e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:55Z,use_quota=True,user_id='6dddfc31965d467bbc3851713859ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Creating volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:55 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-485573c2-493a-429f-98f6-8bb57107e0b3" released by "delete_volume" :: held 1.276s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:55 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 1073741824 Jul 30 16:46:55 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:55 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:55 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Created reservations ['9b5d2c51-d255-4c75-b994-b0228fea37d0', '91d2c1b9-7564-4e88-bc82-368eb49cd669', 'eff92964-0733-49a5-be59-f8f600eab2dd', 'b8be4935-76e5-4b2d-8ef7-42638cf1d961'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:56 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-495deaaa-7df3-4b77-a741-db0d6a443a24" returned: 0 in 0.513s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-quobyte-495deaaa-7df3-4b77-a741-db0d6a443a24" released by "delete_volume" :: held 1.355s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:56 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:56 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:46:56 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Flow 'volume_create_manager' (ce870596-92af-4922-adf2-222699900cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b789bebd-ba91-4b88-a1a9-d1fe568b0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Created reservations ['b1836b64-70f2-4810-a8bf-9363dcd82dc7', '06894893-26ed-40d6-ab85-b5e3c5c18097', '803a2cfe-fbbd-4736-b578-2c3685bbf4b8', '79f01f88-3c00-42b1-b420-c0e5d23376e5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.407s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b789bebd-ba91-4b88-a1a9-d1fe568b0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2136747229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c5fce-4f37-49d0-9ec3-48d5cf24d141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239167bc15bd48eb955af9b08125fa01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:56Z,use_quota=True,user_id='82e7613c2ffe46f68202c55f2ff7da08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef15ffb-8ddb-440d-95bd-3917d7823c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef15ffb-8ddb-440d-95bd-3917d7823c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e48a0-727a-4679-952e-3f3e6ab48f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62e48a0-727a-4679-952e-3f3e6ab48f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114c5fce-4f37-49d0-9ec3-48d5cf24d141', 'volume_name': 'volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be38703-7055-4060-9f70-e698bcf6ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be38703-7055-4060-9f70-e698bcf6ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0811f5f-1a69-42a5-8b93-010097e618b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Volume 114c5fce-4f37-49d0-9ec3-48d5cf24d141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141', 'volume_size': 1} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Deleted volume successfully. Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4dbf88ad-ae27-4036-ae7e-a7cc9a78e4ea tempest-VolumesListAdminTestJSON-1115881256 None] Lock "cinder-0e931f62-026b-44e0-9614-a294f15a4b8a-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:56 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 1073741824" returned: 0 in 0.632s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.326s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:56 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:56 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Deleted volume successfully. Jul 30 16:46:56 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 Jul 30 16:46:56 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-643957ef-863e-4a49-ae6d-3f78b04bc6c7 tempest-TestStampPattern-1707302050 None] Lock "cinder-485573c2-493a-429f-98f6-8bb57107e0b3-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:56 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:56 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Deleted volume successfully. Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2" returned: 0 in 0.277s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:46:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2136747229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c5fce-4f37-49d0-9ec3-48d5cf24d141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='239167bc15bd48eb955af9b08125fa01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:46:56Z,use_quota=True,user_id='82e7613c2ffe46f68202c55f2ff7da08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Creating volume 114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:56 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 1073741824 Jul 30 16:46:56 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b360327b-7296-4e03-8014-985d814ac524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da44378-62eb-494f-a5a7-8c1e328156d2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae505a7-d564-4949-bbbe-9bfb9613c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-56bae6d5-0ef6-43cc-8b96-945bf89681a9 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-495deaaa-7df3-4b77-a741-db0d6a443a24-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Volume volume-5da44378-62eb-494f-a5a7-8c1e328156d2 (5da44378-62eb-494f-a5a7-8c1e328156d2): created successfully Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae505a7-d564-4949-bbbe-9bfb9613c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Flow 'volume_create_manager' (3dd9b271-4fa9-46b4-9b25-0e1d5ef8dda3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b5cbd0d3-83a9-42bb-93cb-d08ef37b6e13 tempest-SnapshotsActionsTest-354372686 None] Created volume successfully. Jul 30 16:46:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "cinder-1e6f63dd-40ab-4004-b9eb-4c2e660be55f-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-3b9702d4-fd95-4310-acc2-0aeee2d50269-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-1e6f63dd-40ab-4004-b9eb-4c2e660be55f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Lock "cinder-3b9702d4-fd95-4310-acc2-0aeee2d50269-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-quobyte-d21a857f-3f50-472d-9b4f-d502d008dd4d" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-d21a857f-3f50-472d-9b4f-d502d008dd4d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-quobyte-3b9702d4-fd95-4310-acc2-0aeee2d50269" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "cinder-quobyte-1e6f63dd-40ab-4004-b9eb-4c2e660be55f" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-3b9702d4-fd95-4310-acc2-0aeee2d50269" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Deleting offline snapshot 3b9702d4-fd95-4310-acc2-0aeee2d50269 of volume d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] snapshot_file for this snap is: volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-quobyte-1e6f63dd-40ab-4004-b9eb-4c2e660be55f" acquired by "delete_volume" :: waited 0.043s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e77a124-f61b-43d7-ab4b-31b9bd6196a0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[830ff5e5-7ea1-4685-86f2-d338adb21f38]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 1073741824" returned: 0 in 0.522s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f Jul 30 16:46:57 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 Jul 30 16:46:57 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 Jul 30 16:46:57 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269" returned: 0 in 0.413s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d21a857f-3f50-472d-9b4f-d502d008dd4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:46:57 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f" returned: 0 in 0.426s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141" returned: 0 in 0.328s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[123bb470-e4aa-47ab-9d3c-957ef421cfba]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f Jul 30 16:46:57 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0811f5f-1a69-42a5-8b93-010097e618b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e770ab-3185-47c7-a175-d1f697883419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:46:57 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Volume volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 (114c5fce-4f37-49d0-9ec3-48d5cf24d141): created successfully Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e770ab-3185-47c7-a175-d1f697883419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Flow 'volume_create_manager' (ce870596-92af-4922-adf2-222699900cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:46:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-24d1d5f2-4279-43c2-a450-894ba1dc4ac0 tempest-CinderUnicodeTest-1869894617 None] Created volume successfully. Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:57 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Creating offline snapshot 6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:46:57 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7def79-aeaf-4831-b859-04e78bf7e09f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:57 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e6f63dd-40ab-4004-b9eb-4c2e660be55f" returned: 0 in 0.285s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:57 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 Jul 30 16:46:57 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-quobyte-1e6f63dd-40ab-4004-b9eb-4c2e660be55f" released by "delete_volume" :: held 0.755s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:57 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Created reservations ['ffa1ca77-b244-40cc-8bc7-27b1864e9926', '9208b514-eb9b-4185-8eab-6f9a249e1036', '96c5c7cb-7925-4925-9377-e590c2ab14cb', 'afc65e26-d575-46b2-bb6f-b454a3661492'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:58 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2" returned: 0 in 0.418s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d" returned: 0 in 0.594s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f 1G Jul 30 16:46:58 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 Jul 30 16:46:58 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.284s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "cinder-1eb1367c-0a25-438f-a919-ee013aa5e38f-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:58 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Deleted volume successfully. Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-1eb1367c-0a25-438f-a919-ee013aa5e38f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3f11f2b-f88c-4db2-9c2b-67e7d370e77f tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-1e6f63dd-40ab-4004-b9eb-4c2e660be55f-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "cinder-quobyte-1eb1367c-0a25-438f-a919-ee013aa5e38f" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-quobyte-1eb1367c-0a25-438f-a919-ee013aa5e38f" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc86f34-204e-4700-83ce-5eb4a5891907]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f Jul 30 16:46:58 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269" returned: 0 in 0.456s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269 Jul 30 16:46:58 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:58 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f 1G" returned: 0 in 0.625s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:46:58 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:58 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f Jul 30 16:46:58 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:58 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d.3b9702d4-fd95-4310-acc2-0aeee2d50269" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-3b9702d4-fd95-4310-acc2-0aeee2d50269" released by "_delete_snapshot" :: held 1.938s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-d21a857f-3f50-472d-9b4f-d502d008dd4d" released by "delete_snapshot" :: held 1.977s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Created reservations ['8f7a65b6-6f9c-4596-8c84-0daccbdf9c29', 'e55b57ba-ad65-44ea-b140-b88a167e8164', 'bae7218b-0cb3-4bb5-b7ff-bf3cebad015d', '0e57d95a-6226-413e-8720-b7ee38f9ccee'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:59 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.342s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f is being set with open permissions: ugo+rw Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:46:59 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Delete snapshot completed successfully. Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-37e351b7-9246-4922-8cf4-ae1d847ca264 tempest-TestStampPattern-1707302050 None] Lock "cinder-3b9702d4-fd95-4310-acc2-0aeee2d50269-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1eb1367c-0a25-438f-a919-ee013aa5e38f" returned: 0 in 0.298s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-quobyte-1eb1367c-0a25-438f-a919-ee013aa5e38f" released by "delete_volume" :: held 0.793s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Created reservations ['f8cb1bc6-3b6c-4fd6-afb6-1726eec10b4f', 'd9ab68ed-1073-4896-8f42-3209122cc69a', 'd655adf2-0c00-4b3c-97fd-ed9aa448f70e', '795c7d5e-ecad-46d2-9b43-08ed427f5a7e'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.260s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:46:59 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info Jul 30 16:46:59 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:46:59 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:46:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Deleted volume successfully. Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-abaec90f-eb8e-4f38-b3c7-fa6161090b24 tempest-VolumesListAdminTestJSON-564616869 None] Lock "cinder-1eb1367c-0a25-438f-a919-ee013aa5e38f-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:46:59 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:46:59 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info is being set with open permissions: ugo+rw Jul 30 16:46:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:46:59 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info Jul 30 16:46:59 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.info" returned: 0 in 0.250s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.304s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.293s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Creating offline snapshot 625e8120-3370-4038-b250-385006e1240c of volume 114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4ca3fad3-8a86-4d6f-8241-a5f351f3961e tempest-SnapshotsActionsTest-354372686 None] Create snapshot completed successfully Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f0009-a77e-4244-b955-c2f68965d936]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 Jul 30 16:47:00 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:00 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141" returned: 0 in 0.426s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:00 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c 1G Jul 30 16:47:00 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c 1G" returned: 0 in 0.653s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c Jul 30 16:47:01 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c" returned: 0 in 0.533s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:01 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c is being set with open permissions: ugo+rw Jul 30 16:47:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:01 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c Jul 30 16:47:01 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:02 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c" returned: 0 in 0.334s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:02 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info Jul 30 16:47:02 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:02 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info" returned: 0 in 0.447s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info is being set with open permissions: ugo+rw Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:02 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info Jul 30 16:47:02 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:02 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.info" returned: 0 in 0.321s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.944s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Creating offline snapshot 77923785-6815-4813-8136-d8c6d697f838 of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2afe828b-58ab-4709-ba56-539b6f695d10 tempest-CinderUnicodeTest-1869894617 None] Create snapshot completed successfully Jul 30 16:47:03 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c3f13-b5fc-4f32-9c19-defc9d9c6ef8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:03 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:03 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:03 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.569s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:03 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 1G Jul 30 16:47:03 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-625e8120-3370-4038-b250-385006e1240c-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-625e8120-3370-4038-b250-385006e1240c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-quobyte-114c5fce-4f37-49d0-9ec3-48d5cf24d141" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-114c5fce-4f37-49d0-9ec3-48d5cf24d141" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-quobyte-625e8120-3370-4038-b250-385006e1240c" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-625e8120-3370-4038-b250-385006e1240c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Deleting offline snapshot 625e8120-3370-4038-b250-385006e1240c of volume 114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] snapshot_file for this snap is: volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:04 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 1G" returned: 0 in 0.715s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4a452f-3975-4a5f-9461-936db631a789]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:04 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 Jul 30 16:47:04 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:04 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c Jul 30 16:47:04 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:04 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838" returned: 0 in 0.646s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:04 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 is being set with open permissions: ugo+rw Jul 30 16:47:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 Jul 30 16:47:05 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:05 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c" returned: 0 in 0.782s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3037812b-5f5c-422e-b7dd-06eeb30dd023]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 Jul 30 16:47:05 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:05 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:05 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b5a246fe-32b1-4f73-99ef-e07627085dc7 tempest-SnapshotsActionsTest-354372686 None] Create snapshot completed successfully Jul 30 16:47:05 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141" returned: 0 in 0.517s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:05 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c Jul 30 16:47:05 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-d21a857f-3f50-472d-9b4f-d502d008dd4d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Lock "cinder-d21a857f-3f50-472d-9b4f-d502d008dd4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Acquiring lock "cinder-quobyte-d21a857f-3f50-472d-9b4f-d502d008dd4d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-d21a857f-3f50-472d-9b4f-d502d008dd4d" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e825418-b45e-45a4-a4c9-76edc7ee0a98]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:06 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c" returned: 0 in 0.489s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:06 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c Jul 30 16:47:06 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d Jul 30 16:47:06 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-77923785-6815-4813-8136-d8c6d697f838-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-77923785-6815-4813-8136-d8c6d697f838-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-77923785-6815-4813-8136-d8c6d697f838" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-77923785-6815-4813-8136-d8c6d697f838" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Deleting offline snapshot 77923785-6815-4813-8136-d8c6d697f838 of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] snapshot_file for this snap is: volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd50bd4-561d-4852-b08d-fa18f2e05f41]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:06 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141.625e8120-3370-4038-b250-385006e1240c" returned: 0 in 0.425s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:06 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d" returned: 0 in 0.514s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-625e8120-3370-4038-b250-385006e1240c" released by "_delete_snapshot" :: held 2.428s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:06 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d Jul 30 16:47:06 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Flow 'volume_create_manager' (643e4078-4728-4744-ab48-6a88ead0355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:06 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 Jul 30 16:47:06 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41d311e-2f5b-48e8-8dff-86be84bd3eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-114c5fce-4f37-49d0-9ec3-48d5cf24d141" released by "delete_snapshot" :: held 2.504s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41d311e-2f5b-48e8-8dff-86be84bd3eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-835016876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf51139f-7778-40ed-badc-82ec67200c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247a26444db64878b5a6db54b3e48612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:07Z,use_quota=True,user_id='d897248ce5604835af7e9efe938fef67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199dad4-633b-4c82-b2b0-3aeb78a61875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199dad4-633b-4c82-b2b0-3aeb78a61875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c73cd6-2334-4f71-a44a-f77cb9604cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Created reservations ['b5fcfbae-0790-4393-95bd-25fa19977ffe', '0350805e-60d0-4255-8384-c7e46516b60f', '8214c21a-68fd-4645-ae7a-63c61453b591', 'd1e61ead-32d7-40ae-ad9c-df5b28739a68'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Delete snapshot completed successfully. Jul 30 16:47:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c5b9bfd7-9526-4e20-a419-9b0bbab498d8 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-625e8120-3370-4038-b250-385006e1240c-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:06 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d21a857f-3f50-472d-9b4f-d502d008dd4d" returned: 0 in 0.316s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Lock "cinder-quobyte-d21a857f-3f50-472d-9b4f-d502d008dd4d" released by "delete_volume" :: held 0.908s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:07 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838" returned: 0 in 0.441s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4202e9f7-6b51-4685-9d18-b19f5b1d7fe2]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c73cd6-2334-4f71-a44a-f77cb9604cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf51139f-7778-40ed-badc-82ec67200c70', 'volume_name': 'volume-cf51139f-7778-40ed-badc-82ec67200c70', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a68b63-1c79-4a2e-9355-404e10e96deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a68b63-1c79-4a2e-9355-404e10e96deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8e79e3-4fa5-41c1-bbc5-222814542901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Volume cf51139f-7778-40ed-badc-82ec67200c70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf51139f-7778-40ed-badc-82ec67200c70', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Trying to clone cf51139f-7778-40ed-badc-82ec67200c70 from image e99749b8-1b47-4194-9cb3-562081ac77f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Created reservations ['6f7d06f5-b9f8-4c34-9072-5e39fd401912', 'f2d4cd80-a933-4ccf-ac95-8ec34d4a4a9d', '5f590882-db83-4b2a-bb37-5c4b9af06cf9', '3183eed3-235e-4023-8d44-88d6a34effc9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:07 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:07 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:07 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:07 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:47:07 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Image download 20.69 MB at 20.69 MB/s Jul 30 16:47:07 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.302s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Deleted volume successfully. Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c6421dca-b701-498e-adc6-ba1329ea9e68 tempest-TestStampPattern-1707302050 None] Lock "cinder-d21a857f-3f50-472d-9b4f-d502d008dd4d-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-114c5fce-4f37-49d0-9ec3-48d5cf24d141-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c439c73-455a-4b59-805b-f436e6f1cd54]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-114c5fce-4f37-49d0-9ec3-48d5cf24d141-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-quobyte-114c5fce-4f37-49d0-9ec3-48d5cf24d141" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-114c5fce-4f37-49d0-9ec3-48d5cf24d141" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:07 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.640s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:07 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD Jul 30 16:47:07 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed4f347-348e-43ed-b17f-dcbfa4ec3532]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:07 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 Jul 30 16:47:07 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:07 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 Jul 30 16:47:07 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:07 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:07 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 is fetched for user d897248ce5604835af7e9efe938fef67. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05e049-7414-4edc-9d24-c283302e1580]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:08 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838" returned: 0 in 0.421s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:08 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141" returned: 0 in 0.419s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:08 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838 Jul 30 16:47:08 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:08 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD Jul 30 16:47:08 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:08 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141 Jul 30 16:47:08 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:08 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-835016876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf51139f-7778-40ed-badc-82ec67200c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247a26444db64878b5a6db54b3e48612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:07Z,use_quota=True,user_id='d897248ce5604835af7e9efe938fef67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Creating volume cf51139f-7778-40ed-badc-82ec67200c70 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:08 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:08 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.77923785-6815-4813-8136-d8c6d697f838" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:08 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 1073741824 Jul 30 16:47:08 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:08 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-114c5fce-4f37-49d0-9ec3-48d5cf24d141" returned: 0 in 0.302s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-77923785-6815-4813-8136-d8c6d697f838" released by "_delete_snapshot" :: held 1.926s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-114c5fce-4f37-49d0-9ec3-48d5cf24d141" released by "delete_volume" :: held 0.809s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" released by "delete_snapshot" :: held 1.967s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Created reservations ['2198cb29-4d26-431e-aedf-843a9f3ac4e4', '62cf9ead-cd19-48f3-a463-d61d34320dcd', '588f0764-7bcb-49bb-8fb4-652f3bbc7b0f', 'b6664b71-9946-4f99-a0ef-82ae8a3df1fc'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Created reservations ['67d7a737-a3b5-4307-80de-0084ef14a847', '59fa3548-b223-4204-9527-c62ea5ef8895', 'c5e66d95-71d3-483a-8239-78cf3057b607', '65f3e39a-4cc7-4ccd-b262-80662a83c1a3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Delete snapshot completed successfully. Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27b2a545-d95f-4ef1-9e3e-0a2191d57ded tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-77923785-6815-4813-8136-d8c6d697f838-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:08 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:08 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-dac74c4e-f7a5-4311-a082-d662e9cde8a3-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-dac74c4e-f7a5-4311-a082-d662e9cde8a3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "cinder-quobyte-dac74c4e-f7a5-4311-a082-d662e9cde8a3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-dac74c4e-f7a5-4311-a082-d662e9cde8a3" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[457991e0-0e14-42c8-a2f6-2053898f2459]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:09 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 1073741824" returned: 0 in 0.677s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:09 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 Jul 30 16:47:09 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:09 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.328s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Deleted volume successfully. Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9746a65a-5d87-46fa-ad58-17d46c1c24a4 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-114c5fce-4f37-49d0-9ec3-48d5cf24d141-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:09 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 Jul 30 16:47:09 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:09 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3" returned: 0 in 0.393s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:09 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3 Jul 30 16:47:09 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:09 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70" returned: 0 in 0.278s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Attempting download of e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume cf51139f-7778-40ed-badc-82ec67200c70. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd1d8f-7dbb-4902-a608-f2f7dd03c2c7]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:09 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dac74c4e-f7a5-4311-a082-d662e9cde8a3" returned: 0 in 0.274s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-quobyte-dac74c4e-f7a5-4311-a082-d662e9cde8a3" released by "delete_volume" :: held 0.718s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:09 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby Jul 30 16:47:09 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Created reservations ['f6c95195-b531-4621-80a3-19f5523f2c17', 'a3aac40e-672f-43d4-97ea-04accd9348b6', '457c2e41-e120-4f1d-a1ce-056003d5dac3', 'f7580dba-4f86-4885-9590-bcd05cfced63'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:09 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:09 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:10 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby" returned: 0 in 0.557s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Creating offline snapshot 3875e9c5-bdc6-4834-8d00-d2998319a3a6 of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:10 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby Jul 30 16:47:10 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[549fbb3a-237a-4bbc-a548-939ee389be2d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:10 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.396s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Deleted volume successfully. Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-92a2f355-64dc-4b0f-b102-4a57bf706153 tempest-CinderUnicodeTest-1869894617 None] Lock "cinder-dac74c4e-f7a5-4311-a082-d662e9cde8a3-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:10 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:10 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:10 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby" returned: 1 in 0.420s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e99749b8-1b47-4194-9cb3-562081ac77f1_5kw8ryby' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf5a830-dc84-4204-927f-f832a12c6fec]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:10 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD Jul 30 16:47:10 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:10 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.615s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:10 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 1G Jul 30 16:47:10 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:11 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] e99749b8-1b47-4194-9cb3-562081ac77f1 was qcow2, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:11 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 Jul 30 16:47:11 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:11 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 1G" returned: 0 in 0.568s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:11 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 Jul 30 16:47:11 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:11 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6" returned: 0 in 0.379s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:11 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 is being set with open permissions: ugo+rw Jul 30 16:47:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:11 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 Jul 30 16:47:11 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:12 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6" returned: 0 in 0.349s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c4001404-1e73-4468-b2c4-849a54b9e3d5 tempest-SnapshotsActionsTest-354372686 None] Create snapshot completed successfully Jul 30 16:47:13 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70" returned: 0 in 2.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e99749b8-1b47-4194-9cb3-562081ac77f1_69gaujpudevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:47:13 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Converted 112.00 MB image at 49.44 MB/s Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 1G Jul 30 16:47:13 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-3875e9c5-bdc6-4834-8d00-d2998319a3a6-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-3875e9c5-bdc6-4834-8d00-d2998319a3a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-3875e9c5-bdc6-4834-8d00-d2998319a3a6" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-3875e9c5-bdc6-4834-8d00-d2998319a3a6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Deleting offline snapshot 3875e9c5-bdc6-4834-8d00-d2998319a3a6 of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] snapshot_file for this snap is: volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9978c5-ab78-4223-a1c7-346ec8fdc0f9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:13 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 Jul 30 16:47:13 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:13 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 1G" returned: 0 in 0.549s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Downloaded image e99749b8-1b47-4194-9cb3-562081ac77f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}])) to volume cf51139f-7778-40ed-badc-82ec67200c70 successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Temporary image e99749b8-1b47-4194-9cb3-562081ac77f1 for user d897248ce5604835af7e9efe938fef67 is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Marking volume cf51139f-7778-40ed-badc-82ec67200c70 as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Copying metadata from image e99749b8-1b47-4194-9cb3-562081ac77f1 to cf51139f-7778-40ed-badc-82ec67200c70. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Creating volume glance metadata for volume cf51139f-7778-40ed-badc-82ec67200c70 backed by image e99749b8-1b47-4194-9cb3-562081ac77f1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8e79e3-4fa5-41c1-bbc5-222814542901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf51139f-7778-40ed-badc-82ec67200c70', 'volume_size': 1, 'image_id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e99749b8-1b47-4194-9cb3-562081ac77f1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eeb497340c9f456da5528f539ff9e54a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e99749b8-1b47-4194-9cb3-562081ac77f1', 'created_at': datetime.datetime(2026, 7, 30, 14, 28, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e99749b8-1b47-4194-9cb3-562081ac77f1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7b219f-575d-4159-8943-f8be27cba0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:13 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Volume volume-cf51139f-7778-40ed-badc-82ec67200c70 (cf51139f-7778-40ed-badc-82ec67200c70): created successfully Jul 30 16:47:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7b219f-575d-4159-8943-f8be27cba0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Flow 'volume_create_manager' (643e4078-4728-4744-ab48-6a88ead0355d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e69b6cb3-7b6d-4f64-96a0-a52c9e96f4d4 tempest-VolumesImageMetadata-866824791 None] Created volume successfully. Jul 30 16:47:14 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6" returned: 0 in 0.473s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0eacd1-dc19-4a55-83db-0dde94c7557c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:14 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:14 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:14 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Acquiring lock "cinder-cf51139f-7778-40ed-badc-82ec67200c70-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.485s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Lock "cinder-cf51139f-7778-40ed-badc-82ec67200c70-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:14 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 Jul 30 16:47:14 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Acquiring lock "cinder-quobyte-cf51139f-7778-40ed-badc-82ec67200c70" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Lock "cinder-quobyte-cf51139f-7778-40ed-badc-82ec67200c70" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4af84-9a40-41c3-b186-5d49263afa1c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:14 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 Jul 30 16:47:14 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6" returned: 0 in 0.515s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:15 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6 Jul 30 16:47:15 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=193,cinder:SELECT=182,cinder:DELETE=14,cinder:INSERT=56 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=165,cinder:INSERT=56,cinder:UPDATE=205,cinder:DELETE=16 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:15 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Flow 'volume_create_manager' (ce5f57ba-8a35-4b7e-8c3e-d80ce2f2b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e8a6ee-2bc6-4443-9897-25ed777d7592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70" returned: 0 in 0.529s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:15 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70 Jul 30 16:47:15 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e8a6ee-2bc6-4443-9897-25ed777d7592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488057208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b27b9c-bc5b-4916-8196-fe7d8cb69330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efdf4e79f844189ba6dbb68d5516dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:15Z,use_quota=True,user_id='38639b31f243435caa733bc54aba591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b151a83-fe14-4923-9abd-54f67be71e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b151a83-fe14-4923-9abd-54f67be71e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470698a9-c5bf-4da4-83f9-a1953c4b450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470698a9-c5bf-4da4-83f9-a1953c4b450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b27b9c-bc5b-4916-8196-fe7d8cb69330', 'volume_name': 'volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be819b1-2ca1-4329-ba47-c85759818c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be819b1-2ca1-4329-ba47-c85759818c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4518a2b0-23a1-4a5b-bfbe-54d96f8613cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:15 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Volume a6b27b9c-bc5b-4916-8196-fe7d8cb69330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330', 'volume_size': 1} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488057208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b27b9c-bc5b-4916-8196-fe7d8cb69330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efdf4e79f844189ba6dbb68d5516dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:15Z,use_quota=True,user_id='38639b31f243435caa733bc54aba591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Creating volume a6b27b9c-bc5b-4916-8196-fe7d8cb69330 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:15 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:15 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 1073741824 Jul 30 16:47:15 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:15 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.3875e9c5-bdc6-4834-8d00-d2998319a3a6" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-3875e9c5-bdc6-4834-8d00-d2998319a3a6" released by "_delete_snapshot" :: held 1.976s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" released by "delete_snapshot" :: held 2.018s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Created reservations ['e30b6c7b-717d-4d05-9179-9ca16557f0e3', '8a494270-cd98-4350-958f-9764c1705137', 'b3754135-46e8-4545-8e46-df3e9f662622', '8588d1a8-2e03-475a-ae90-3ead794ff1fa'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:15 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-cf51139f-7778-40ed-badc-82ec67200c70" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Delete snapshot completed successfully. Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Lock "cinder-quobyte-cf51139f-7778-40ed-badc-82ec67200c70" released by "delete_volume" :: held 1.037s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-27799fc8-89c0-45e1-b8cf-9d6526039664 tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-3875e9c5-bdc6-4834-8d00-d2998319a3a6-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Created reservations ['a0aedd75-980a-4f0c-9701-7ce6e5e5d956', '1f0b1060-1646-4c72-a177-20f8385c0eb4', '8ee6537e-af39-44ac-8088-75771329c073', '85f3f654-021d-4ef9-96fa-e4f897013450'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:16 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:16 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:16 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 1073741824" returned: 0 in 0.693s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:16 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 Jul 30 16:47:16 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:16 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Deleted volume successfully. Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-eaf8ec69-a68b-4be2-bfc2-31b13fdfaca5 tempest-VolumesImageMetadata-866824791 None] Lock "cinder-cf51139f-7778-40ed-badc-82ec67200c70-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:16 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.174s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4518a2b0-23a1-4a5b-bfbe-54d96f8613cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdf3dbd-2e13-4a30-8bc6-ac669297ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Creating offline snapshot e4f80c19-9dfa-4146-a5b4-861b3a852987 of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:16 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Volume volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 (a6b27b9c-bc5b-4916-8196-fe7d8cb69330): created successfully Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdf3dbd-2e13-4a30-8bc6-ac669297ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Flow 'volume_create_manager' (ce5f57ba-8a35-4b7e-8c3e-d80ce2f2b250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[71445531-36e3-41fc-9fa7-defcc440c30f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3b30de2c-34d7-4498-8e17-dfbf9b4b7faf tempest-ProjectReaderTests-972224434 None] Created volume successfully. Jul 30 16:47:16 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:16 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:16 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 1G Jul 30 16:47:17 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:17 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 1G" returned: 0 in 0.603s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:17 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 Jul 30 16:47:17 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Acquiring lock "cinder-a6b27b9c-bc5b-4916-8196-fe7d8cb69330-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Lock "cinder-a6b27b9c-bc5b-4916-8196-fe7d8cb69330-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Acquiring lock "cinder-quobyte-a6b27b9c-bc5b-4916-8196-fe7d8cb69330" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Lock "cinder-quobyte-a6b27b9c-bc5b-4916-8196-fe7d8cb69330" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb4829-2571-4c09-9592-39fee5e8bae9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:18 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 Jul 30 16:47:18 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:18 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987" returned: 0 in 0.526s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 is being set with open permissions: ugo+rw Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:18 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 Jul 30 16:47:18 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:18 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330" returned: 0 in 0.486s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:18 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330 Jul 30 16:47:18 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:18 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ab66145c-516b-4c66-b0c6-387f2480ace6 tempest-SnapshotsActionsTest-354372686 None] Create snapshot completed successfully Jul 30 16:47:18 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6b27b9c-bc5b-4916-8196-fe7d8cb69330" returned: 0 in 0.305s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Lock "cinder-quobyte-a6b27b9c-bc5b-4916-8196-fe7d8cb69330" released by "delete_volume" :: held 0.842s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Created reservations ['3abbc63c-8cb2-41aa-b561-b6e8a04f9049', 'dfea98af-1b14-412f-95b8-8cb5c86d5a5a', '51c194ac-ff1b-4921-97bd-2ac4bd33eb8a', '7b500086-1efd-4bd8-aecd-412766ea096b'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:18 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:18 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:19 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:19 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Deleted volume successfully. Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7b0754bb-6ca8-463b-82fc-579d2b58ff0a tempest-ProjectReaderTests-972224434 None] Lock "cinder-a6b27b9c-bc5b-4916-8196-fe7d8cb69330-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Flow 'volume_create_manager' (bd05b021-5da9-46f1-ad86-f6cef7cca27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57588668-4135-45d4-8f47-727b19edc5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57588668-4135-45d4-8f47-727b19edc5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-740415418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60df5109-aabf-4fb6-85e5-a7d67d64991d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efdf4e79f844189ba6dbb68d5516dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:19Z,use_quota=True,user_id='38639b31f243435caa733bc54aba591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b653d67f-b9ab-46f4-a5f0-b810551bd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b653d67f-b9ab-46f4-a5f0-b810551bd431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1545357-e360-4ba7-ad2a-42d2043d498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1545357-e360-4ba7-ad2a-42d2043d498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60df5109-aabf-4fb6-85e5-a7d67d64991d', 'volume_name': 'volume-60df5109-aabf-4fb6-85e5-a7d67d64991d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b20c32f-ae17-4f0e-881b-3ee5e3bad11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b20c32f-ae17-4f0e-881b-3ee5e3bad11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9e74e2-f60a-4d6d-a300-7a09773fadb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:19 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Volume 60df5109-aabf-4fb6-85e5-a7d67d64991d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60df5109-aabf-4fb6-85e5-a7d67d64991d', 'volume_size': 1} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-740415418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60df5109-aabf-4fb6-85e5-a7d67d64991d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efdf4e79f844189ba6dbb68d5516dc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:19Z,use_quota=True,user_id='38639b31f243435caa733bc54aba591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Creating volume 60df5109-aabf-4fb6-85e5-a7d67d64991d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:19 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:19 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d 1073741824 Jul 30 16:47:19 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-e4f80c19-9dfa-4146-a5b4-861b3a852987-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-e4f80c19-9dfa-4146-a5b4-861b3a852987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-e4f80c19-9dfa-4146-a5b4-861b3a852987" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-e4f80c19-9dfa-4146-a5b4-861b3a852987" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Deleting offline snapshot e4f80c19-9dfa-4146-a5b4-861b3a852987 of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] snapshot_file for this snap is: volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c57b2e-936c-4f03-b840-46ffe52811e9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:19 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 Jul 30 16:47:19 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:20 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d 1073741824" returned: 0 in 0.592s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:20 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987" returned: 0 in 0.499s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:20 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d Jul 30 16:47:20 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73da12-e3d4-4386-a226-9eee73be4b0e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:20 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:20 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:20 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d" returned: 0 in 0.376s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9e74e2-f60a-4d6d-a300-7a09773fadb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60df5109-aabf-4fb6-85e5-a7d67d64991d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205b3fcb-57ec-4bce-b8e8-4fb77299c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:20 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Volume volume-60df5109-aabf-4fb6-85e5-a7d67d64991d (60df5109-aabf-4fb6-85e5-a7d67d64991d): created successfully Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205b3fcb-57ec-4bce-b8e8-4fb77299c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Flow 'volume_create_manager' (bd05b021-5da9-46f1-ad86-f6cef7cca27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:20 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-90ac329f-0a66-424b-bf3a-0b9d490d6d71 tempest-ProjectReaderTests-972224434 None] Created volume successfully. Jul 30 16:47:20 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.476s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:20 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 Jul 30 16:47:20 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:21 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Flow 'volume_create_manager' (481808c2-de33-4086-86d1-f25d08bd1237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0d45a7-5390-4dc2-a913-b685d237bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:21 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987 Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0d45a7-5390-4dc2-a913-b685d237bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-473101408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a30234-94de-4253-a27a-9be0461d0b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3925b94178b242e2b95ec2ca16f01b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:21Z,use_quota=True,user_id='cf05209d3211482b994602df604beda3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:21 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262fa05c-3279-4bd0-a254-74b77cbb483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262fa05c-3279-4bd0-a254-74b77cbb483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2611e5-0cf7-4d07-be0a-67b13e1614b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d2611e5-0cf7-4d07-be0a-67b13e1614b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a30234-94de-4253-a27a-9be0461d0b5d', 'volume_name': 'volume-08a30234-94de-4253-a27a-9be0461d0b5d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffe3525-cba5-4ca1-bbd2-a2bc2dee3fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffe3525-cba5-4ca1-bbd2-a2bc2dee3fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9d16f-bdf8-4660-80f1-0d34978dee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:21 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Volume 08a30234-94de-4253-a27a-9be0461d0b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a30234-94de-4253-a27a-9be0461d0b5d', 'volume_size': 1} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-473101408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a30234-94de-4253-a27a-9be0461d0b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3925b94178b242e2b95ec2ca16f01b8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:21Z,use_quota=True,user_id='cf05209d3211482b994602df604beda3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Creating volume 08a30234-94de-4253-a27a-9be0461d0b5d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:21 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:21 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d 1073741824 Jul 30 16:47:21 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:21 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.e4f80c19-9dfa-4146-a5b4-861b3a852987" returned: 0 in 0.314s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Acquiring lock "cinder-60df5109-aabf-4fb6-85e5-a7d67d64991d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-e4f80c19-9dfa-4146-a5b4-861b3a852987" released by "_delete_snapshot" :: held 1.939s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" released by "delete_snapshot" :: held 1.977s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Lock "cinder-60df5109-aabf-4fb6-85e5-a7d67d64991d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Acquiring lock "cinder-quobyte-60df5109-aabf-4fb6-85e5-a7d67d64991d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Lock "cinder-quobyte-60df5109-aabf-4fb6-85e5-a7d67d64991d" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[141b6ff6-aea0-4dfd-8e19-509e45134104]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Created reservations ['5a220dd5-644f-4d5e-b5f7-6f1925d2a763', '065e2fbc-fa2b-4b78-b6c9-a142904d489c', 'a0ac1f78-fb47-4292-a59f-422bf011def3', 'd3451179-b810-4bf7-8001-c7caf31bcb3a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Delete snapshot completed successfully. Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8243692e-9263-43eb-8ad8-57930904859e tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-e4f80c19-9dfa-4146-a5b4-861b3a852987-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:21 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d Jul 30 16:47:21 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:21 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d 1073741824" returned: 0 in 0.599s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:22 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d Jul 30 16:47:22 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:22 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d" returned: 0 in 0.430s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:22 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d Jul 30 16:47:22 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:22 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d" returned: 0 in 0.278s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9d16f-bdf8-4660-80f1-0d34978dee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a30234-94de-4253-a27a-9be0461d0b5d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e53e32-b864-401c-8023-fe9d920759aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:22 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Volume volume-08a30234-94de-4253-a27a-9be0461d0b5d (08a30234-94de-4253-a27a-9be0461d0b5d): created successfully Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e53e32-b864-401c-8023-fe9d920759aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Flow 'volume_create_manager' (481808c2-de33-4086-86d1-f25d08bd1237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e1b5c2b4-0f89-4967-a872-2097644202b4 tempest-VolumesMetadataTest-1751262975 None] Created volume successfully. Jul 30 16:47:22 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-60df5109-aabf-4fb6-85e5-a7d67d64991d" returned: 0 in 0.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Lock "cinder-quobyte-60df5109-aabf-4fb6-85e5-a7d67d64991d" released by "delete_volume" :: held 0.743s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Created reservations ['4af460a4-1039-4fd6-ae0c-08fc124606a3', '13149e4b-e487-4340-baeb-857ef757f58c', 'aa32f433-ce87-4649-8833-db9de538d896', '6793b426-3319-4a30-812b-7c495c0bba61'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:22 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:22 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:22 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.288s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Deleted volume successfully. Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3a5ccc03-31ff-45ad-aef0-1940badebe07 tempest-ProjectReaderTests-972224434 None] Lock "cinder-60df5109-aabf-4fb6-85e5-a7d67d64991d-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Creating offline snapshot 9d451218-f696-4ebe-ab3d-a4d819029bad of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e9dc94-5317-4f34-b55e-651b850a44a4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:23 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:23 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:23 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.479s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:23 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad 1G Jul 30 16:47:23 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Acquiring lock "cinder-08a30234-94de-4253-a27a-9be0461d0b5d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Lock "cinder-08a30234-94de-4253-a27a-9be0461d0b5d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Acquiring lock "cinder-quobyte-08a30234-94de-4253-a27a-9be0461d0b5d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:24 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad 1G" returned: 0 in 0.670s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Lock "cinder-quobyte-08a30234-94de-4253-a27a-9be0461d0b5d" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:24 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad Jul 30 16:47:24 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9badb2ca-a044-4497-9a60-c341b99fdd80]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:24 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d Jul 30 16:47:24 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:24 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad" returned: 0 in 0.388s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:24 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad is being set with open permissions: ugo+rw Jul 30 16:47:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:24 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad Jul 30 16:47:24 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:25 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d" returned: 0 in 0.546s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:25 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d Jul 30 16:47:25 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:25 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad" returned: 0 in 0.323s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-41387070-b1e8-4a88-bf64-d9e99fdcf9cc tempest-SnapshotsActionsTest-354372686 None] Create snapshot completed successfully Jul 30 16:47:25 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-08a30234-94de-4253-a27a-9be0461d0b5d" returned: 0 in 0.405s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Lock "cinder-quobyte-08a30234-94de-4253-a27a-9be0461d0b5d" released by "delete_volume" :: held 1.015s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-9d451218-f696-4ebe-ab3d-a4d819029bad-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-9d451218-f696-4ebe-ab3d-a4d819029bad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Acquiring lock "cinder-quobyte-9d451218-f696-4ebe-ab3d-a4d819029bad" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-9d451218-f696-4ebe-ab3d-a4d819029bad" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Deleting offline snapshot 9d451218-f696-4ebe-ab3d-a4d819029bad of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] snapshot_file for this snap is: volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[96844aa3-2928-440d-a541-9aff40e66e8c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Created reservations ['611a3e6c-8862-4ab7-8d5a-65bcf27bfe94', 'b8880f83-ba9f-490e-8130-00d1424bd69f', '7a7eb924-6507-4bf6-85ab-f30822c6a204', '2144fcb1-b165-44bd-83c4-e58cac450627'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:25 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad Jul 30 16:47:25 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:25 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:25 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:26 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Deleted volume successfully. Jul 30 16:47:26 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad" returned: 0 in 0.471s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-536423b4-5ad0-47a1-a0bf-a3ee3eafab8f tempest-VolumesMetadataTest-1751262975 None] Lock "cinder-08a30234-94de-4253-a27a-9be0461d0b5d-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb8bdf-bd61-492b-8267-2bdce8365bb3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:26 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:26 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:26 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:26 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad Jul 30 16:47:26 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:27 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad" returned: 0 in 0.507s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:27 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad Jul 30 16:47:27 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:27 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.9d451218-f696-4ebe-ab3d-a4d819029bad" returned: 0 in 0.346s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-9d451218-f696-4ebe-ab3d-a4d819029bad" released by "_delete_snapshot" :: held 1.930s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" released by "delete_snapshot" :: held 1.996s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Created reservations ['24733203-b536-4c72-a60e-a7c2ef62ee08', '15f256bd-b5ff-49b6-9ed3-bc54aed1e672', '2e0046ea-2389-4fc6-a42d-13fc61f02127', '535cb8c3-9a9e-4d98-92e0-ba3e9b54fb55'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:28 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Delete snapshot completed successfully. Jul 30 16:47:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-be8cb3d6-7fd5-4ca8-8784-d593aa73eebc tempest-SnapshotsActionsTest-1028383198 None] Lock "cinder-9d451218-f696-4ebe-ab3d-a4d819029bad-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "cinder-6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" acquired by "delete_snapshot" :: waited 0.117s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "cinder-quobyte-6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-quobyte-6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Deleting offline snapshot 6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f of volume 5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] snapshot_file for this snap is: volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d4a47-4521-4b59-91e5-2c0b1450d8b8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:29 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:29 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:30 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.405s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5da44378-62eb-494f-a5a7-8c1e328156d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ee0ac-cb97-498a-8b8f-ba4cff6cbe86]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:30 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 Jul 30 16:47:30 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:30 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2" returned: 0 in 0.492s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:30 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:30 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (834c04d5-a0d6-426b-b032-0ebc8c591d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58508306-fdf2-4458-b38f-551afe275414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58508306-fdf2-4458-b38f-551afe275414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689762527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad4b2f8-c995-4233-b651-3d22d2acc826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:31Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4cf9f9-f45a-4db5-8cca-12578569fa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4cf9f9-f45a-4db5-8cca-12578569fa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc12c31-053a-431e-913e-f717c76b2bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc12c31-053a-431e-913e-f717c76b2bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad4b2f8-c995-4233-b651-3d22d2acc826', 'volume_name': 'volume-2ad4b2f8-c995-4233-b651-3d22d2acc826', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5597080a-757e-47cf-aac9-d0538e0fb1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5597080a-757e-47cf-aac9-d0538e0fb1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3031d8e-ec76-47c5-b08c-8640d35230f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:30 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Volume 2ad4b2f8-c995-4233-b651-3d22d2acc826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad4b2f8-c995-4233-b651-3d22d2acc826', 'volume_size': 1} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689762527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad4b2f8-c995-4233-b651-3d22d2acc826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:31Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Creating volume 2ad4b2f8-c995-4233-b651-3d22d2acc826 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:30 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:31 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 1073741824 Jul 30 16:47:31 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:31 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.589s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:31 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f Jul 30 16:47:31 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:31 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 1073741824" returned: 0 in 0.552s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:31 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2.6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" returned: 0 in 0.355s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-quobyte-6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f" released by "_delete_snapshot" :: held 1.977s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" released by "delete_snapshot" :: held 2.043s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:31 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 Jul 30 16:47:31 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Created reservations ['a5ba9f99-b614-4999-b176-da1755813476', 'c01a48c8-bc99-45f5-bc9c-755e6213fd0d', '5b58679c-e9d3-43f4-a788-b8dcb0552fac', 'b9507e49-0a5f-40a8-8abc-5744b12a25c0'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Delete snapshot completed successfully. Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec086179-b095-48a6-95b8-15f377e4d259 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-6e6e4c9a-8ea1-4fe4-af4c-f5ec25147d2f-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:31 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826" returned: 0 in 0.354s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3031d8e-ec76-47c5-b08c-8640d35230f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad4b2f8-c995-4233-b651-3d22d2acc826', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e36bd6-2701-4b46-ba1e-3d8d129f95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:32 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Volume volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 (2ad4b2f8-c995-4233-b651-3d22d2acc826): created successfully Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e36bd6-2701-4b46-ba1e-3d8d129f95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (834c04d5-a0d6-426b-b032-0ebc8c591d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-49306b69-8f62-4493-aae6-0eb1cab830f1 tempest-ProjectReaderTests-1990319659 None] Created volume successfully. Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "cinder-5da44378-62eb-494f-a5a7-8c1e328156d2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-5da44378-62eb-494f-a5a7-8c1e328156d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ef259-123f-4f18-80cc-d7ae4991b0b8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 Jul 30 16:47:33 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Flow 'volume_create_manager' (c31d9dcb-361c-4dfa-82d5-195daae8568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc84ae5e-d0f0-4e34-ae43-d94ecc955835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc84ae5e-d0f0-4e34-ae43-d94ecc955835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1196362299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0d2b9f-bc5a-49c4-b949-bebea1304437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6053af5722934ecf98898685fb5e00ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:33Z,use_quota=True,user_id='56aa8d1f1e3d4b4ba15bd7b5b6ddbf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be97089-6e7a-4128-87a7-41931ca97474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be97089-6e7a-4128-87a7-41931ca97474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d85151-ff1e-4860-af7f-410fafe4429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d85151-ff1e-4860-af7f-410fafe4429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0d2b9f-bc5a-49c4-b949-bebea1304437', 'volume_name': 'volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72cbe53-9797-46a3-aa82-ac348c78583b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72cbe53-9797-46a3-aa82-ac348c78583b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f355aff2-b2ae-48ee-91fd-25e24574f74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Volume 2c0d2b9f-bc5a-49c4-b949-bebea1304437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437', 'volume_size': 1} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1196362299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c0d2b9f-bc5a-49c4-b949-bebea1304437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6053af5722934ecf98898685fb5e00ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:33Z,use_quota=True,user_id='56aa8d1f1e3d4b4ba15bd7b5b6ddbf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Creating volume 2c0d2b9f-bc5a-49c4-b949-bebea1304437 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:33 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-2ad4b2f8-c995-4233-b651-3d22d2acc826-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:33 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 1073741824 Jul 30 16:47:33 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Lock "cinder-2ad4b2f8-c995-4233-b651-3d22d2acc826-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-quobyte-2ad4b2f8-c995-4233-b651-3d22d2acc826" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-2ad4b2f8-c995-4233-b651-3d22d2acc826" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:33 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2" returned: 0 in 0.404s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[68705a48-3643-4752-abcb-434116acc897]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2 Jul 30 16:47:33 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 Jul 30 16:47:33 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5da44378-62eb-494f-a5a7-8c1e328156d2" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-quobyte-5da44378-62eb-494f-a5a7-8c1e328156d2" released by "delete_volume" :: held 0.772s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Created reservations ['76b9230d-84c5-4df3-9e05-55c0ec0348b3', 'f63024c0-6b95-45c7-bb85-c3b7ed9eca4d', 'f603893a-fa66-476a-8023-c7221b12d6eb', '346339e8-7a11-4184-a750-f067f849a0bd'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:33 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 1073741824" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826" returned: 0 in 0.404s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 Jul 30 16:47:33 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826 Jul 30 16:47:33 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:33 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:33 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:33 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437" returned: 0 in 0.271s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f355aff2-b2ae-48ee-91fd-25e24574f74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61157d9-1d86-4b33-9c1f-f4c6f5b22f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2ad4b2f8-c995-4233-b651-3d22d2acc826" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Volume volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 (2c0d2b9f-bc5a-49c4-b949-bebea1304437): created successfully Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61157d9-1d86-4b33-9c1f-f4c6f5b22f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Flow 'volume_create_manager' (c31d9dcb-361c-4dfa-82d5-195daae8568c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-2ad4b2f8-c995-4233-b651-3d22d2acc826" released by "delete_volume" :: held 0.771s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:34 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:34 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-74cd8d1d-e307-47da-8b45-709745cc84c4 tempest-VolumesTransfersV355Test-138683916 None] Created volume successfully. Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:34 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Deleted volume successfully. Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d8ade8ee-673c-4ade-bbf7-5a2b2f4bd2e3 tempest-SnapshotsActionsTest-354372686 None] Lock "cinder-5da44378-62eb-494f-a5a7-8c1e328156d2-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Created reservations ['e4838e56-ba21-452a-9a98-b6c1157e310f', '1b2db731-0f5a-423f-a88b-3094eb708b63', 'b0fdd0af-a181-4cc0-9232-a26e3d8c4548', '9cdf7c32-735f-4bfc-96bb-362eef3b4cbb'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:34 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:34 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:34 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:34 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Deleted volume successfully. Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09b1fe18-a2cb-453c-ad1d-9070a620f4aa tempest-ProjectReaderTests-1990319659 None] Lock "cinder-2ad4b2f8-c995-4233-b651-3d22d2acc826-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (543973f8-0a82-4e08-bba7-88a5f68b4309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f393034-7aa9-41d5-93b1-653a8f0c0ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f393034-7aa9-41d5-93b1-653a8f0c0ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884614074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edcd062-97c2-4866-9a30-e7b55f2fd59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:35Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7986bfd-8407-4d92-bae1-1a4c70674c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7986bfd-8407-4d92-bae1-1a4c70674c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30026885-33da-4f63-84b9-638c59bf19ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30026885-33da-4f63-84b9-638c59bf19ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edcd062-97c2-4866-9a30-e7b55f2fd59b', 'volume_name': 'volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b94cbc-19f3-4a50-941a-c84aa05275e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15b94cbc-19f3-4a50-941a-c84aa05275e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a99a271-e97d-451b-8456-d60c27518773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Volume 9edcd062-97c2-4866-9a30-e7b55f2fd59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b', 'volume_size': 1} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884614074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edcd062-97c2-4866-9a30-e7b55f2fd59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:35Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Creating volume 9edcd062-97c2-4866-9a30-e7b55f2fd59b {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:34 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:34 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b 1073741824 Jul 30 16:47:34 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:35 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b 1073741824" returned: 0 in 0.527s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:35 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b Jul 30 16:47:35 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:35 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b" returned: 0 in 0.399s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a99a271-e97d-451b-8456-d60c27518773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d3e28e-0f8d-442d-925d-cdd00162d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Volume volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b (9edcd062-97c2-4866-9a30-e7b55f2fd59b): created successfully Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d3e28e-0f8d-442d-925d-cdd00162d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (543973f8-0a82-4e08-bba7-88a5f68b4309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ed685365-7499-489e-9d82-997b98372de1 tempest-ProjectReaderTests-1990319659 None] Created volume successfully. Jul 30 16:47:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3448537e-a9ed-4bb6-bf7d-19ae2d1a849a tempest-VolumesTransfersV355Test-1597417743 None] Transfer volume completed successfully. Jul 30 16:47:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Acquiring lock "cinder-2c0d2b9f-bc5a-49c4-b949-bebea1304437-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-2c0d2b9f-bc5a-49c4-b949-bebea1304437-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Acquiring lock "cinder-quobyte-2c0d2b9f-bc5a-49c4-b949-bebea1304437" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-quobyte-2c0d2b9f-bc5a-49c4-b949-bebea1304437" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:36 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319b406-d46e-4fe2-972b-c6ae1bd47af2]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-9edcd062-97c2-4866-9a30-e7b55f2fd59b-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:37 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 Jul 30 16:47:37 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-9edcd062-97c2-4866-9a30-e7b55f2fd59b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-quobyte-9edcd062-97c2-4866-9a30-e7b55f2fd59b" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-9edcd062-97c2-4866-9a30-e7b55f2fd59b" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ba7844-f24c-4fb7-ac16-82e27ba3e40f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b Jul 30 16:47:37 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437" returned: 0 in 0.408s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437 Jul 30 16:47:37 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b Jul 30 16:47:37 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2c0d2b9f-bc5a-49c4-b949-bebea1304437" returned: 0 in 0.287s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-quobyte-2c0d2b9f-bc5a-49c4-b949-bebea1304437" released by "delete_volume" :: held 0.745s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Created reservations ['ce3cedba-f7e0-4a10-a368-87efeaab31c3', 'b95d1acd-3c6c-4b53-a6c2-33454e4cc9cf', '413701b3-4287-4cf7-9898-762e4f7f412f', '043efd82-97e7-479f-aa66-f9be581b30d7'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:37 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:37 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:37 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9edcd062-97c2-4866-9a30-e7b55f2fd59b" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-9edcd062-97c2-4866-9a30-e7b55f2fd59b" released by "delete_volume" :: held 0.716s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Created reservations ['bc3c7368-d897-403c-9c35-4bceefd3f7f8', 'd67cc510-abcb-4e03-a04f-03ce71ee06d3', '532c9bc0-e161-4991-bdb4-7038e0a30a78', '4d056c5d-1bf3-4f33-b323-79f5775bb1bf'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:38 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.295s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Deleted volume successfully. Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6dd2721b-8892-4e1d-8e48-c4e1d4334e37 tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-2c0d2b9f-bc5a-49c4-b949-bebea1304437-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:38 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Deleted volume successfully. Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f008e3e9-dd4a-4e2f-a38e-b393412f3ee7 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-9edcd062-97c2-4866-9a30-e7b55f2fd59b-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Flow 'volume_create_manager' (f8662a10-9308-48f5-970f-cc08f02046ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f465671a-a7b0-4bb3-bbce-a45fe25eade5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f465671a-a7b0-4bb3-bbce-a45fe25eade5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-790992543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6053af5722934ecf98898685fb5e00ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:39Z,use_quota=True,user_id='56aa8d1f1e3d4b4ba15bd7b5b6ddbf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6662c6ad-1a87-4067-a181-33cbb19d6f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6662c6ad-1a87-4067-a181-33cbb19d6f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bd88d1-a2e7-4d48-a09e-d392f86f49dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99bd88d1-a2e7-4d48-a09e-d392f86f49dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb', 'volume_name': 'volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2575646-dd0a-4048-9875-2c5d034d21f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2575646-dd0a-4048-9875-2c5d034d21f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b91123-124b-4a7c-ad7f-48c621a2cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Volume 464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb', 'volume_size': 1} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-790992543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6053af5722934ecf98898685fb5e00ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:39Z,use_quota=True,user_id='56aa8d1f1e3d4b4ba15bd7b5b6ddbf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Creating volume 464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:38 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:38 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb 1073741824 Jul 30 16:47:38 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:38 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (f858e33d-479e-44fa-a923-d030c056e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bd1498-cdb9-4cb6-9e89-421b1270837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bd1498-cdb9-4cb6-9e89-421b1270837b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509886606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65c2dd1-8e67-4e38-972e-a8bb8ac36c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:39Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f95a91-cc30-40ff-b935-cbea35723e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f95a91-cc30-40ff-b935-cbea35723e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de06158b-1c45-4964-aa6d-e2d11a0a05c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de06158b-1c45-4964-aa6d-e2d11a0a05c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65c2dd1-8e67-4e38-972e-a8bb8ac36c02', 'volume_name': 'volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69150c4-879d-4b07-84ce-ea355cbaef18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69150c4-879d-4b07-84ce-ea355cbaef18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6cab35-9360-4a54-b44b-0c7f529db938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Volume f65c2dd1-8e67-4e38-972e-a8bb8ac36c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02', 'volume_size': 1} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:39 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb 1073741824" returned: 0 in 0.510s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:39 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb Jul 30 16:47:39 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:39 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb" returned: 0 in 0.270s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.706s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509886606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65c2dd1-8e67-4e38-972e-a8bb8ac36c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:39Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Creating volume f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:39 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b91123-124b-4a7c-ad7f-48c621a2cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 1073741824 Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5268d4a8-2b6e-4790-b176-005a1d9e98b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:39 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:39 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Volume volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb (464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb): created successfully Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5268d4a8-2b6e-4790-b176-005a1d9e98b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:39 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Flow 'volume_create_manager' (f8662a10-9308-48f5-970f-cc08f02046ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2ca4de84-f312-47cb-a1b4-88788941579d tempest-VolumesTransfersV355Test-138683916 None] Created volume successfully. Jul 30 16:47:40 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 1073741824" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:40 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 Jul 30 16:47:40 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:40 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6cab35-9360-4a54-b44b-0c7f529db938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0ff9b6-34b1-4317-8fba-a52b071aa4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Volume volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 (f65c2dd1-8e67-4e38-972e-a8bb8ac36c02): created successfully Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0ff9b6-34b1-4317-8fba-a52b071aa4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (f858e33d-479e-44fa-a923-d030c056e739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:40 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2a3ba97d-9da5-4500-8739-4a5c18da321e tempest-ProjectReaderTests-1990319659 None] Created volume successfully. Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-quobyte-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1803ed5e-222e-43de-870a-ba703abdc216]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Acquiring lock "cinder-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Acquiring lock "cinder-quobyte-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:41 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 Jul 30 16:47:41 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-quobyte-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e3beb2-b807-4ab7-a89b-50369f112b8f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:41 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb Jul 30 16:47:41 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02" returned: 0 in 0.456s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:41 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02 Jul 30 16:47:41 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb" returned: 0 in 0.461s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:41 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb Jul 30 16:47:41 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:41 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02" returned: 0 in 0.335s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02" released by "delete_volume" :: held 0.854s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:41 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Created reservations ['56c04c96-1313-4c4a-8a55-5617b9c2cd1c', '3be79780-99a9-487f-ae69-378805ff511c', '6b839c60-d909-40db-8c6c-4b048a41dc7b', '637b56cd-22e2-4236-be55-6dfaef29eca2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:42 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-quobyte-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb" released by "delete_volume" :: held 0.862s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:42 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:42 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Created reservations ['fe1954ad-a243-4719-a590-173da7a9b784', 'd8a4a83f-6a14-4efc-9e57-3413f27e5f3b', '4cbc884f-c58e-4a52-8d69-776f3534382a', '09e6949b-4746-429c-8c11-0726709603bc'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:42 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:42 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.404s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Deleted volume successfully. Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3433b452-2f38-4a53-bff4-850c957f08d9 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-f65c2dd1-8e67-4e38-972e-a8bb8ac36c02-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:42 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.445s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Deleted volume successfully. Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4fa96b2f-d553-4a40-bbf0-ce45d0a835cf tempest-VolumesTransfersV355Test-1472859587 None] Lock "cinder-464eb3e5-c3a4-48fa-a33f-5ef416fbe4bb-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (44873e5d-e3cf-43ef-8d66-ebbc5914d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94ce05-33a1-4e7d-8686-05b580ebe733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94ce05-33a1-4e7d-8686-05b580ebe733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164891259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9855dd-d65c-4fbf-94bb-e526601e1878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:43Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f7376-4b3f-4a8e-a0b2-1118343c69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f7376-4b3f-4a8e-a0b2-1118343c69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69183b70-830b-4bd2-9bbf-af73c334a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69183b70-830b-4bd2-9bbf-af73c334a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9855dd-d65c-4fbf-94bb-e526601e1878', 'volume_name': 'volume-6a9855dd-d65c-4fbf-94bb-e526601e1878', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0407aa64-f1e7-42ac-b42d-a40b77e1dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0407aa64-f1e7-42ac-b42d-a40b77e1dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5db42b-6d31-4d89-bb42-31534b2bea0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Volume 6a9855dd-d65c-4fbf-94bb-e526601e1878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9855dd-d65c-4fbf-94bb-e526601e1878', 'volume_size': 1} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164891259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9855dd-d65c-4fbf-94bb-e526601e1878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20fa8f0d9c24ca59dc0161b9ec4c8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:43Z,use_quota=True,user_id='1c3d7c21a289452da4df5380342efbce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Creating volume 6a9855dd-d65c-4fbf-94bb-e526601e1878 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:42 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:42 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 1073741824 Jul 30 16:47:42 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:43 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 1073741824" returned: 0 in 0.539s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:43 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 Jul 30 16:47:43 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:43 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5db42b-6d31-4d89-bb42-31534b2bea0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9855dd-d65c-4fbf-94bb-e526601e1878', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf1ddcc-dcae-410b-82b7-576d5db68224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Volume volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 (6a9855dd-d65c-4fbf-94bb-e526601e1878): created successfully Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf1ddcc-dcae-410b-82b7-576d5db68224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Flow 'volume_create_manager' (44873e5d-e3cf-43ef-8d66-ebbc5914d14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7cef92ee-77aa-4895-aab5-e4093af44baa tempest-ProjectReaderTests-1990319659 None] Created volume successfully. Jul 30 16:47:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-6a9855dd-d65c-4fbf-94bb-e526601e1878-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-6a9855dd-d65c-4fbf-94bb-e526601e1878-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "cinder-quobyte-6a9855dd-d65c-4fbf-94bb-e526601e1878" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-6a9855dd-d65c-4fbf-94bb-e526601e1878" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2fadb7-6f87-4934-83d4-72ce4dc0f1c3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:45 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 Jul 30 16:47:45 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:45 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:45 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878 Jul 30 16:47:45 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:45 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6a9855dd-d65c-4fbf-94bb-e526601e1878" returned: 0 in 0.287s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-quobyte-6a9855dd-d65c-4fbf-94bb-e526601e1878" released by "delete_volume" :: held 0.790s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:45 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Created reservations ['d9256216-3fdd-48bd-b084-873b2ba59ee5', '9340708c-6c3e-4f10-9886-c5bef11ed2e9', '14b8da4d-6e5f-4254-9c94-c99df421b5f1', '8f5ffbca-1c62-4bb3-98c6-d890bef6f4ee'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:46 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:46 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:46 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.266s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Deleted volume successfully. Jul 30 16:47:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f43a8c9e-2828-42ea-a732-359bcd538a77 tempest-ProjectReaderTests-1990319659 None] Lock "cinder-6a9855dd-d65c-4fbf-94bb-e526601e1878-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Flow 'volume_create_manager' (c765e9f5-5985-4109-a6ba-26fc9f9dcb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5273949f-a207-4361-9cd5-c1988626b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5273949f-a207-4361-9cd5-c1988626b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2060818591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117bfd50-c5ce-451f-b964-2ff433f367c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c86c1ca98a24ea5bf8359b94d3d19e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:50Z,use_quota=True,user_id='9aaa4bec6a0d416eb3c724ac21208029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd2b18e-edcc-4843-a3db-0149ef7f8f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd2b18e-edcc-4843-a3db-0149ef7f8f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f08684c-8cf1-4e44-92fe-60b6b30b38f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f08684c-8cf1-4e44-92fe-60b6b30b38f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117bfd50-c5ce-451f-b964-2ff433f367c4', 'volume_name': 'volume-117bfd50-c5ce-451f-b964-2ff433f367c4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c8f239-7968-4e57-a0a4-39af0f97dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c8f239-7968-4e57-a0a4-39af0f97dd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d6ff25-a77c-45a8-a484-355d39e365a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:49 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Volume 117bfd50-c5ce-451f-b964-2ff433f367c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117bfd50-c5ce-451f-b964-2ff433f367c4', 'volume_size': 1} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2060818591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117bfd50-c5ce-451f-b964-2ff433f367c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c86c1ca98a24ea5bf8359b94d3d19e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:50Z,use_quota=True,user_id='9aaa4bec6a0d416eb3c724ac21208029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Creating volume 117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:47:49 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:47:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:49 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 1073741824 Jul 30 16:47:49 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 1073741824" returned: 0 in 0.438s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:50 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 Jul 30 16:47:50 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:50 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4" returned: 0 in 0.257s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d6ff25-a77c-45a8-a484-355d39e365a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117bfd50-c5ce-451f-b964-2ff433f367c4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832116a2-28d9-4c77-b706-ba0a1eb55e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:50 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Volume volume-117bfd50-c5ce-451f-b964-2ff433f367c4 (117bfd50-c5ce-451f-b964-2ff433f367c4): created successfully Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832116a2-28d9-4c77-b706-ba0a1eb55e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Flow 'volume_create_manager' (c765e9f5-5985-4109-a6ba-26fc9f9dcb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6b77d6bb-2217-44b0-ab38-4154452bdece tempest-VolumesCloneTest-1651224427 None] Created volume successfully. Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Flow 'volume_create_manager' (482a9b3a-bb28-4278-9e74-2bb960469856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1633eba4-30d9-4502-945c-5dc127f3e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1633eba4-30d9-4502-945c-5dc127f3e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-257335397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770c4947-0dbf-402d-817f-9c7630a839e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c86c1ca98a24ea5bf8359b94d3d19e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=117bfd50-c5ce-451f-b964-2ff433f367c4,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:52Z,use_quota=True,user_id='9aaa4bec6a0d416eb3c724ac21208029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549f7922-e023-43a7-b1ad-848508eb50e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549f7922-e023-43a7-b1ad-848508eb50e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68870339-12c5-409d-92c9-fad2a5f849c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68870339-12c5-409d-92c9-fad2a5f849c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '770c4947-0dbf-402d-817f-9c7630a839e0', 'volume_name': 'volume-770c4947-0dbf-402d-817f-9c7630a839e0', 'volume_size': 2, 'source_volid': '117bfd50-c5ce-451f-b964-2ff433f367c4', 'source_volstatus': 'available'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddc7ead-fb7f-4375-a408-f9dc23f17f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddc7ead-fb7f-4375-a408-f9dc23f17f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f2412f-391b-4a87-96a5-43e4a397d19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:52 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Volume 770c4947-0dbf-402d-817f-9c7630a839e0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-770c4947-0dbf-402d-817f-9c7630a839e0', 'volume_size': 2, 'source_volid': '117bfd50-c5ce-451f-b964-2ff433f367c4', 'source_volstatus': 'available'} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:52 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Cloning volume 117bfd50-c5ce-451f-b964-2ff433f367c4 to volume 770c4947-0dbf-402d-817f-9c7630a839e0 Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Creating offline snapshot 7b3cd24b-6647-402e-8352-ff6f8c4d40af of volume 117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a18312-6ee2-45d8-8f41-731d340ce29d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:52 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 Jul 30 16:47:52 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:52 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4" returned: 0 in 0.358s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:52 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af 1G Jul 30 16:47:52 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Flow 'volume_create_manager' (dd2f25f6-a8a5-4931-893d-9555cc3509d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c8cbb0-406c-47c9-a07f-b52e9c4d741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c8cbb0-406c-47c9-a07f-b52e9c4d741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1485615827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd481d79-8f3c-4a55-ac81-5d3713dbc4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc6c9af2cb2422795922494a20baac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:53Z,use_quota=True,user_id='9aa8ba38dc1c4d0f95101aa54b3cf239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4dccc7-2198-4b18-8f81-0dfd26500496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4dccc7-2198-4b18-8f81-0dfd26500496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec7e576-77fb-45c1-a28b-a2608215f5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec7e576-77fb-45c1-a28b-a2608215f5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd481d79-8f3c-4a55-ac81-5d3713dbc4c7', 'volume_name': 'volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61bef71-c32f-4698-b205-91745d5d7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61bef71-c32f-4698-b205-91745d5d7df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7afeab-d937-4cdb-ad73-fe2539aea526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:47:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Volume dd481d79-8f3c-4a55-ac81-5d3713dbc4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7', 'volume_size': 1} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:53 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af 1G" returned: 0 in 0.460s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117bfd50-c5ce-451f-b964-2ff433f367c4 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117bfd50-c5ce-451f-b964-2ff433f367c4 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af Jul 30 16:47:53 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117bfd50-c5ce-451f-b964-2ff433f367c4 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af" returned: 0 in 0.263s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af is being set with open permissions: ugo+rw Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af Jul 30 16:47:53 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af" returned: 0 in 0.232s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info Jul 30 16:47:53 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:53 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info" returned: 0 in 0.238s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:53 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info is being set with open permissions: ugo+rw Jul 30 16:47:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:53 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info Jul 30 16:47:53 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.info" returned: 0 in 0.237s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Acquiring lock "cinder-quobyte-770c4947-0dbf-402d-817f-9c7630a839e0" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-770c4947-0dbf-402d-817f-9c7630a839e0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] snapshot: 7b3cd24b-6647-402e-8352-ff6f8c4d40af, volume: 770c4947-0dbf-402d-817f-9c7630a839e0, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[964636a9-fc7c-48df-9610-b01bb5324ca8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af Jul 30 16:47:54 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af" returned: 0 in 0.349s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117bfd50-c5ce-451f-b964-2ff433f367c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d3ba88-c3f1-4557-9420-16c7bd8f400e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:47:54 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 Jul 30 16:47:54 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:54 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:47:54 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4" returned: 0 in 0.340s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:47:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:54 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 Jul 30 16:47:54 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:58 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0" returned: 0 in 3.908s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:58 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4, size 1024.00 MB, duration 3.91 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:47:58 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Converted 1024.00 MB image at 261.96 MB/s Jul 30 16:47:58 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 is being set with open permissions: ugo+rw Jul 30 16:47:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:58 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 Jul 30 16:47:58 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:59 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0" returned: 0 in 0.227s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-770c4947-0dbf-402d-817f-9c7630a839e0" released by "_copy_volume_from_snapshot" :: held 4.880s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Acquiring lock "cinder-quobyte-7b3cd24b-6647-402e-8352-ff6f8c4d40af" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-7b3cd24b-6647-402e-8352-ff6f8c4d40af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Deleting offline snapshot 7b3cd24b-6647-402e-8352-ff6f8c4d40af of volume 117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] snapshot_file for this snap is: volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f1ef05-7d8b-4dcf-892b-f57fa262c89d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af Jul 30 16:47:59 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:47:59 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117bfd50-c5ce-451f-b964-2ff433f367c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd7edc4-6eea-490c-bbce-539a471316be]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:47:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:47:59 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 Jul 30 16:47:59 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4" returned: 0 in 0.516s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af Jul 30 16:48:00 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af" returned: 0 in 0.320s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af Jul 30 16:48:00 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4.7b3cd24b-6647-402e-8352-ff6f8c4d40af" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-7b3cd24b-6647-402e-8352-ff6f8c4d40af" released by "_delete_snapshot" :: held 1.517s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.357s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.493s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:47:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1485615827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd481d79-8f3c-4a55-ac81-5d3713dbc4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc6c9af2cb2422795922494a20baac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:47:53Z,use_quota=True,user_id='9aa8ba38dc1c4d0f95101aa54b3cf239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Creating volume dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:00 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:00 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 1073741824 Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f2412f-391b-4a87-96a5-43e4a397d19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770c4947-0dbf-402d-817f-9c7630a839e0', 'volume_size': 2, 'source_volid': '117bfd50-c5ce-451f-b964-2ff433f367c4', 'source_volstatus': 'available'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:00 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9448b1ba-10ea-4ec5-894d-a5883cb0b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:00 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Volume volume-770c4947-0dbf-402d-817f-9c7630a839e0 (770c4947-0dbf-402d-817f-9c7630a839e0): created successfully Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9448b1ba-10ea-4ec5-894d-a5883cb0b553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:00 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Flow 'volume_create_manager' (482a9b3a-bb28-4278-9e74-2bb960469856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-444d1030-6525-4119-8b4e-f5921ebad28e tempest-VolumesCloneTest-1651224427 None] Created volume successfully. Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Acquiring lock "cinder-770c4947-0dbf-402d-817f-9c7630a839e0-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Lock "cinder-770c4947-0dbf-402d-817f-9c7630a839e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Acquiring lock "cinder-quobyte-770c4947-0dbf-402d-817f-9c7630a839e0" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-770c4947-0dbf-402d-817f-9c7630a839e0" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffd5c70-7d0b-4db5-8d8b-3f284c61cbf5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 1073741824" returned: 0 in 0.468s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 Jul 30 16:48:01 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 Jul 30 16:48:01 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf7afeab-d937-4cdb-ad73-fe2539aea526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccfa8f6-2dfe-44b5-bd9c-9e4b3e99e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:01 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Volume volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 (dd481d79-8f3c-4a55-ac81-5d3713dbc4c7): created successfully Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccfa8f6-2dfe-44b5-bd9c-9e4b3e99e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Flow 'volume_create_manager' (dd2f25f6-a8a5-4931-893d-9555cc3509d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9a83e58d-f85c-433e-bf0d-98066cd6aeae tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Created volume successfully. Jul 30 16:48:01 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0" returned: 0 in 0.377s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0 Jul 30 16:48:01 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:01 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-770c4947-0dbf-402d-817f-9c7630a839e0" returned: 0 in 0.250s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-770c4947-0dbf-402d-817f-9c7630a839e0" released by "delete_volume" :: held 0.672s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Created reservations ['09613658-e779-473d-8939-84549b209523', '1f37aaf2-8850-4d06-8102-17989160509d', 'ab3c6952-935c-469f-8411-5e24c2cf3074', 'ccd0af5c-303b-48b6-bfa3-c971a17bc15b'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:01 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:01 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:02 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.266s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Deleted volume successfully. Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-95445381-ee1e-4975-a5f3-ab4b45a2130a tempest-VolumesCloneTest-1651224427 None] Lock "cinder-770c4947-0dbf-402d-817f-9c7630a839e0-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Acquiring lock "cinder-117bfd50-c5ce-451f-b964-2ff433f367c4-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Lock "cinder-117bfd50-c5ce-451f-b964-2ff433f367c4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Acquiring lock "cinder-quobyte-117bfd50-c5ce-451f-b964-2ff433f367c4" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-117bfd50-c5ce-451f-b964-2ff433f367c4" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8570787e-71e1-4a63-9a45-f211708ec8a8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:02 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 Jul 30 16:48:02 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Acquiring lock "cinder-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "cinder-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Acquiring lock "cinder-quobyte-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "cinder-quobyte-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[39de6ae4-e363-450f-b12d-8121d25e9d62]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:02 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4" returned: 0 in 0.457s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:03 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4 Jul 30 16:48:03 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 Jul 30 16:48:03 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-117bfd50-c5ce-451f-b964-2ff433f367c4" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Lock "cinder-quobyte-117bfd50-c5ce-451f-b964-2ff433f367c4" released by "delete_volume" :: held 0.781s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Created reservations ['307df0a9-ad45-4b14-80ea-99f51aa53f5f', 'dc90e7da-d840-4257-b9b2-4230b83a5571', '98ba79a4-6591-452a-94e3-dcd92f08010b', '9a641f14-323d-406f-a961-6be81335da9d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:03 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7" returned: 0 in 0.371s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:03 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7 Jul 30 16:48:03 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:03 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:03 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:03 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7" returned: 0 in 0.261s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "cinder-quobyte-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7" released by "delete_volume" :: held 0.676s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Created reservations ['c7db5af7-fd20-41a2-b439-43df8aa5bbaf', 'a01f1a6a-42fc-482d-bcb6-24d81d79bfbf', '69dde544-54d9-4ee0-8ed4-525fd52e1354', 'db0eeb2a-7c9b-4c39-a9bc-95ab25ba8579'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:03 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Deleted volume successfully. Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ceb0f937-c23e-4cba-8121-d26929ae11de tempest-VolumesCloneTest-1651224427 None] Lock "cinder-117bfd50-c5ce-451f-b964-2ff433f367c4-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:03 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:03 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:04 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:04 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Deleted volume successfully. Jul 30 16:48:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-012fbaf3-25eb-412a-a5c4-1b09aca995ed tempest-VolumeQuotasNegativeTestJSON-1943209020 None] Lock "cinder-dd481d79-8f3c-4a55-ac81-5d3713dbc4c7-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Flow 'volume_create_manager' (08f5f865-d7af-4503-a2e6-54bb0bd701cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7126c429-3cbc-4267-90e4-07869dbd76f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7126c429-3cbc-4267-90e4-07869dbd76f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1057816313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5baae71e68a47a3bf75d27c8e54397d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:07Z,use_quota=True,user_id='f48a3ee2e3b84db08e68e27e8dc9de32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee31afa2-1ae6-459e-ac37-2ea4284ece5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee31afa2-1ae6-459e-ac37-2ea4284ece5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0673780-a82f-4410-b500-ed7497d41021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0673780-a82f-4410-b500-ed7497d41021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6', 'volume_name': 'volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b47d14f-80b6-4755-8264-846560b9275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b47d14f-80b6-4755-8264-846560b9275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f1809-da26-419d-83c3-8d8c853a32a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Volume 1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6', 'volume_size': 1} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1057816313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5baae71e68a47a3bf75d27c8e54397d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:07Z,use_quota=True,user_id='f48a3ee2e3b84db08e68e27e8dc9de32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Creating volume 1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:06 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:06 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 1073741824 Jul 30 16:48:06 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:07 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 1073741824" returned: 0 in 0.470s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:07 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 Jul 30 16:48:07 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:07 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6" returned: 0 in 0.265s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686f1809-da26-419d-83c3-8d8c853a32a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a86789-c50d-4dcf-8698-070ec38be40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Volume volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 (1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6): created successfully Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a86789-c50d-4dcf-8698-070ec38be40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Flow 'volume_create_manager' (08f5f865-d7af-4503-a2e6-54bb0bd701cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2ff08fba-4ea6-4315-b7e8-a2322f5f242e tempest-VolumesNegativeTest-285918755 None] Created volume successfully. Jul 30 16:48:17 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=127,cinder:INSERT=37,cinder:UPDATE=175,cinder:DELETE=14 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:17 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=118,cinder:INSERT=50,cinder:UPDATE=177,cinder:DELETE=15 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Flow 'volume_create_manager' (f5f19b3d-80a9-4d73-b59e-6e5bc985dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e718ab83-d607-4f66-be8b-42e88b6f14a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e718ab83-d607-4f66-be8b-42e88b6f14a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-817799441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c31881-9af8-48c4-b6c2-75a68bc2c989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71516b45233542439b8535f1edafab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:19Z,use_quota=True,user_id='4c5ec4b353a944658c626699efb37485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c318eb-f212-4dc6-9dc1-ee974b483f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c318eb-f212-4dc6-9dc1-ee974b483f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee38783c-d2c0-4661-888d-4cfff94427dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee38783c-d2c0-4661-888d-4cfff94427dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c31881-9af8-48c4-b6c2-75a68bc2c989', 'volume_name': 'volume-92c31881-9af8-48c4-b6c2-75a68bc2c989', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7914afe-ec02-4774-8723-1449bbb8bd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7914afe-ec02-4774-8723-1449bbb8bd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc558f3-31cc-41fd-b0ca-b210a5e13625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:18 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Volume 92c31881-9af8-48c4-b6c2-75a68bc2c989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c31881-9af8-48c4-b6c2-75a68bc2c989', 'volume_size': 1} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-817799441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c31881-9af8-48c4-b6c2-75a68bc2c989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71516b45233542439b8535f1edafab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:19Z,use_quota=True,user_id='4c5ec4b353a944658c626699efb37485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Creating volume 92c31881-9af8-48c4-b6c2-75a68bc2c989 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:18 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:18 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 1073741824 Jul 30 16:48:18 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:19 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 1073741824" returned: 0 in 0.510s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:19 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 Jul 30 16:48:19 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:19 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989" returned: 0 in 0.290s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc558f3-31cc-41fd-b0ca-b210a5e13625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c31881-9af8-48c4-b6c2-75a68bc2c989', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbcb7bd-f200-4d4e-822c-9826093927cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:19 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Volume volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 (92c31881-9af8-48c4-b6c2-75a68bc2c989): created successfully Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbcb7bd-f200-4d4e-822c-9826093927cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Flow 'volume_create_manager' (f5f19b3d-80a9-4d73-b59e-6e5bc985dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:19 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a6ab95c4-54fb-45d9-9a8c-89f4ca1aad26 tempest-VolumesTransfersV357Test-1347463465 None] Created volume successfully. Jul 30 16:48:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a972b2a7-794d-4bbd-a6ae-e5de3954ca28 tempest-VolumesTransfersV357Test-1842388180 None] Transfer volume completed successfully. Jul 30 16:48:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Acquiring lock "cinder-92c31881-9af8-48c4-b6c2-75a68bc2c989-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-92c31881-9af8-48c4-b6c2-75a68bc2c989-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Acquiring lock "cinder-quobyte-92c31881-9af8-48c4-b6c2-75a68bc2c989" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-quobyte-92c31881-9af8-48c4-b6c2-75a68bc2c989" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c0bf57-3177-4789-9fb2-b914a685c74e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:22 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 Jul 30 16:48:22 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:22 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989" returned: 0 in 0.361s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:22 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989 Jul 30 16:48:22 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:22 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-92c31881-9af8-48c4-b6c2-75a68bc2c989" returned: 0 in 0.257s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-quobyte-92c31881-9af8-48c4-b6c2-75a68bc2c989" released by "delete_volume" :: held 0.663s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Created reservations ['63e5ee46-c1b2-4324-a5ff-1d221c67dc5e', 'b1bad166-12d5-4361-94ad-5bdf8dae4bcb', '5eced5f2-0892-4e4c-9776-1f8ba739d55d', '3f4911d0-82d4-4602-bb58-e2df640bef8d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:22 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:22 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:23 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Deleted volume successfully. Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bae64894-a8c7-4e44-8697-6bf41bac332a tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-92c31881-9af8-48c4-b6c2-75a68bc2c989-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Flow 'volume_create_manager' (4847efbd-5a7a-44e0-8c50-202fa3dfbcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b6fa27-bafc-4f4a-a346-be3b7cf2ee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b6fa27-bafc-4f4a-a346-be3b7cf2ee08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-641941073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db099131-472f-4262-a8f5-e90310730ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71516b45233542439b8535f1edafab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:24Z,use_quota=True,user_id='4c5ec4b353a944658c626699efb37485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b11587e-14ae-4113-b7bf-7cf0cb70b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b11587e-14ae-4113-b7bf-7cf0cb70b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d5ffd8-cb8b-4602-87ef-b5ba3ede768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d5ffd8-cb8b-4602-87ef-b5ba3ede768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db099131-472f-4262-a8f5-e90310730ffc', 'volume_name': 'volume-db099131-472f-4262-a8f5-e90310730ffc', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264354f4-6e81-405b-a1a8-e18dea889579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264354f4-6e81-405b-a1a8-e18dea889579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbd1184-2309-4ebd-8a7c-1b6ca401ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:23 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Volume db099131-472f-4262-a8f5-e90310730ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db099131-472f-4262-a8f5-e90310730ffc', 'volume_size': 1} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-641941073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db099131-472f-4262-a8f5-e90310730ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71516b45233542439b8535f1edafab33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:24Z,use_quota=True,user_id='4c5ec4b353a944658c626699efb37485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Creating volume db099131-472f-4262-a8f5-e90310730ffc {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:23 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:23 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc 1073741824 Jul 30 16:48:23 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:24 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc 1073741824" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:24 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc Jul 30 16:48:24 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:24 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc" returned: 0 in 0.247s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbd1184-2309-4ebd-8a7c-1b6ca401ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db099131-472f-4262-a8f5-e90310730ffc', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115c0b40-4a90-4ea3-b374-904121351fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:24 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Volume volume-db099131-472f-4262-a8f5-e90310730ffc (db099131-472f-4262-a8f5-e90310730ffc): created successfully Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115c0b40-4a90-4ea3-b374-904121351fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Flow 'volume_create_manager' (4847efbd-5a7a-44e0-8c50-202fa3dfbcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-aabd780f-6656-4a36-935e-c8a15d93808c tempest-VolumesTransfersV357Test-1347463465 None] Created volume successfully. Jul 30 16:48:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Acquiring lock "cinder-db099131-472f-4262-a8f5-e90310730ffc-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-db099131-472f-4262-a8f5-e90310730ffc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Acquiring lock "cinder-quobyte-db099131-472f-4262-a8f5-e90310730ffc" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-quobyte-db099131-472f-4262-a8f5-e90310730ffc" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be5bed-14f5-4f34-a40c-ea7c2344a042]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:25 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc Jul 30 16:48:25 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:25 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc" returned: 0 in 0.387s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:25 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc Jul 30 16:48:25 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:25 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-db099131-472f-4262-a8f5-e90310730ffc" returned: 0 in 0.246s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-quobyte-db099131-472f-4262-a8f5-e90310730ffc" released by "delete_volume" :: held 0.680s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Created reservations ['3e3e0ae0-9ec7-4ad1-b976-21d428a69723', '7913cd6f-023e-4e30-adb6-6fc656764172', '988fbc15-1bf4-4af8-9554-3370e33aa7d5', 'bef6e2a1-2889-4a6b-9d53-988cd0026190'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:25 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:25 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:26 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.269s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Deleted volume successfully. Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a3509f59-8cd7-4b3e-b530-a4da6ad1daa6 tempest-VolumesTransfersV357Test-747909641 None] Lock "cinder-db099131-472f-4262-a8f5-e90310730ffc-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Acquiring lock "cinder-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Lock "cinder-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Acquiring lock "cinder-quobyte-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Lock "cinder-quobyte-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df5872-3e53-41d0-895e-19e7a8f51587]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:26 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 Jul 30 16:48:26 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:26 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6" returned: 0 in 0.381s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:26 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6 Jul 30 16:48:26 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:27 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Lock "cinder-quobyte-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6" released by "delete_volume" :: held 0.700s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Created reservations ['d2e81dbc-aaec-440e-9eb9-fec93af41b3d', '06206678-e526-449a-b924-9af7ed2a0cee', '4f96295c-4199-4f54-9fb3-a9c358cf9203', 'e73ce14c-64ec-49a6-8fd6-c75c23133ff5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:27 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:27 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:27 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.312s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Deleted volume successfully. Jul 30 16:48:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8d745d1-88e6-401a-b8a6-625498f99db9 tempest-VolumesNegativeTest-285918755 None] Lock "cinder-1e7cfe2a-90fb-4c82-ac60-1c630bec8dd6-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Flow 'volume_create_manager' (519f57ae-a8fe-468c-9b79-b2ec726c5836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c864610-55d9-46b5-bbbf-00f43433ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c864610-55d9-46b5-bbbf-00f43433ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1608416062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f64dcb-a858-4042-9632-585551c2195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71da9304758247739f095c3b4234908e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:32Z,use_quota=True,user_id='75aef6223d2645649f7960e7699953de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fd6022-ef20-414e-8452-eca3e30522ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fd6022-ef20-414e-8452-eca3e30522ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ecbcd8-ec54-408b-8f30-a64c9b0bef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ecbcd8-ec54-408b-8f30-a64c9b0bef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f64dcb-a858-4042-9632-585551c2195d', 'volume_name': 'volume-a6f64dcb-a858-4042-9632-585551c2195d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8b2dec-1c3c-45f3-a2e4-3deb262bc90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8b2dec-1c3c-45f3-a2e4-3deb262bc90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b2fbc9-4ba4-47b8-9c3b-806e4a3fdc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:32 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Volume a6f64dcb-a858-4042-9632-585551c2195d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f64dcb-a858-4042-9632-585551c2195d', 'volume_size': 1} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1608416062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6f64dcb-a858-4042-9632-585551c2195d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71da9304758247739f095c3b4234908e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:32Z,use_quota=True,user_id='75aef6223d2645649f7960e7699953de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Creating volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:32 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:32 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d 1073741824 Jul 30 16:48:32 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:32 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d 1073741824" returned: 0 in 0.502s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:32 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d Jul 30 16:48:32 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:33 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b2fbc9-4ba4-47b8-9c3b-806e4a3fdc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f64dcb-a858-4042-9632-585551c2195d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36538446-e2c7-4061-8714-032faf143f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Volume volume-a6f64dcb-a858-4042-9632-585551c2195d (a6f64dcb-a858-4042-9632-585551c2195d): created successfully Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36538446-e2c7-4061-8714-032faf143f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Flow 'volume_create_manager' (519f57ae-a8fe-468c-9b79-b2ec726c5836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-25629c89-b6c8-46cd-87aa-833239f9a937 tempest-VolumesSnapshotListTestJSON-1620942807 None] Created volume successfully. Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Creating offline snapshot 3fb42fd1-78ed-47a9-abd0-a01491b53536 of volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6703fa0-7da4-4a5c-8681-83acde6ac71d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:34 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d Jul 30 16:48:34 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:34 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d" returned: 0 in 0.455s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:34 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 1G Jul 30 16:48:34 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:35 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 1G" returned: 0 in 0.413s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:35 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:35 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:35 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:35 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 is being set with open permissions: ugo+rw Jul 30 16:48:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:35 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:35 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:35 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:35 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info Jul 30 16:48:35 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:36 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info" returned: 0 in 0.279s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:36 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info is being set with open permissions: ugo+rw Jul 30 16:48:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:36 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info Jul 30 16:48:36 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:36 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.info" returned: 0 in 0.265s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-316a7128-043f-4c71-b861-10c2641578ac tempest-VolumesSnapshotListTestJSON-1620942807 None] Create snapshot completed successfully Jul 30 16:48:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Creating offline snapshot 35a7123f-c804-4649-af60-9dd388d20df5 of volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4216388-68a6-4e39-8e57-93f0ed97fd64]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:37 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:37 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:38 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:38 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 1G Jul 30 16:48:38 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:38 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 1G" returned: 0 in 0.534s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:38 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:38 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:39 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:39 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 is being set with open permissions: ugo+rw Jul 30 16:48:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:39 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:39 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:39 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.301s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.691s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4c9660c5-988d-4b0a-a423-b9f4db4fb599 tempest-VolumesSnapshotListTestJSON-1620942807 None] Create snapshot completed successfully Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Creating offline snapshot fd33d015-938f-478a-b130-899737a01d9e of volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b7d3a-1477-4efc-93ae-c6d6cdf2d6b9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:40 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:40 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:40 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (170cb317-4208-45b7-910e-f9338d70511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125c2e18-1c58-45a8-9359-d0bb8f19b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.444s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:40 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e 1G Jul 30 16:48:40 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125c2e18-1c58-45a8-9359-d0bb8f19b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1894831361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb24013-6c1d-46b8-89ab-56dda4a2b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:41Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f753dd24-b95b-41cf-bd74-5136791876cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f753dd24-b95b-41cf-bd74-5136791876cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ced9516-d38f-44fc-9115-7b33b8e5133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ced9516-d38f-44fc-9115-7b33b8e5133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb24013-6c1d-46b8-89ab-56dda4a2b154', 'volume_name': 'volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f600bd-11cc-4e00-844f-d97e9f464bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f600bd-11cc-4e00-844f-d97e9f464bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bb47a4-4ce8-49cb-bcab-8ca7db84e2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Volume 1cb24013-6c1d-46b8-89ab-56dda4a2b154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154', 'volume_size': 1} Jul 30 16:48:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:41 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e 1G" returned: 0 in 0.450s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:41 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e Jul 30 16:48:41 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:41 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e" returned: 0 in 0.279s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:41 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e is being set with open permissions: ugo+rw Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:41 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e Jul 30 16:48:41 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:41 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e" returned: 0 in 0.239s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.510s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1894831361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb24013-6c1d-46b8-89ab-56dda4a2b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:41Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Creating volume 1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:41 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:41 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 1073741824 Jul 30 16:48:41 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-18f657a2-eedb-4d79-90e6-ba15616e9a19 tempest-VolumesSnapshotListTestJSON-1620942807 None] Create snapshot completed successfully Jul 30 16:48:42 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 1073741824" returned: 0 in 0.427s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:42 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 Jul 30 16:48:42 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:42 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bb47a4-4ce8-49cb-bcab-8ca7db84e2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44a420a-3598-45d9-85f5-b0b7041bd43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Volume volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 (1cb24013-6c1d-46b8-89ab-56dda4a2b154): created successfully Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44a420a-3598-45d9-85f5-b0b7041bd43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (170cb317-4208-45b7-910e-f9338d70511d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5c7efa7e-4615-4a2d-885b-a312c3c9c31e tempest-VolumesSnapshotTestJSON-18703483 None] Created volume successfully. Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Creating offline snapshot e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a of volume 1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c9629-1101-42a3-a08d-8355ae4bd354]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-fd33d015-938f-478a-b130-899737a01d9e-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-fd33d015-938f-478a-b130-899737a01d9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-fd33d015-938f-478a-b130-899737a01d9e" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-fd33d015-938f-478a-b130-899737a01d9e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Deleting offline snapshot fd33d015-938f-478a-b130-899737a01d9e of volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:43 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 Jul 30 16:48:43 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] snapshot_file for this snap is: volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8bcfe6-9fab-4ca8-8cdb-0de04ec74aa9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:43 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e Jul 30 16:48:43 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:43 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154" returned: 0 in 0.370s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:43 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a 1G Jul 30 16:48:43 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:43 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e" returned: 0 in 0.380s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfedefe-3057-425d-a77b-0f125b324f77]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:43 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:43 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:43 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a 1G" returned: 0 in 0.433s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:43 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a Jul 30 16:48:43 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:43 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:43 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e Jul 30 16:48:43 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:44 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" returned: 0 in 0.304s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:44 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a is being set with open permissions: ugo+rw Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:44 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a Jul 30 16:48:44 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:44 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e" returned: 0 in 0.409s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:44 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:44 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e Jul 30 16:48:44 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:44 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info Jul 30 16:48:44 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:44 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.fd33d015-938f-478a-b130-899737a01d9e" returned: 0 in 0.260s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-fd33d015-938f-478a-b130-899737a01d9e" released by "_delete_snapshot" :: held 1.551s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" released by "delete_snapshot" :: held 1.574s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:44 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info" returned: 0 in 0.263s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:44 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info is being set with open permissions: ugo+rw Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:44 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info Jul 30 16:48:44 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Created reservations ['c753fe19-c512-4dc2-88bc-ef6ed1fbab39', '8d945bf3-364a-4f83-ae1c-1118929163c5', '3461d5ce-5a3a-42c7-bf66-493a3bb81130', '143922df-abe4-4d19-9314-b7f06eba593a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Delete snapshot completed successfully. Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-67bc1e0f-7e36-47d0-b159-7da0b6eab7ce tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-fd33d015-938f-478a-b130-899737a01d9e-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:44 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.info" returned: 0 in 0.237s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-561dea12-4680-4991-b3e9-0e154f7fabc3 tempest-VolumesSnapshotTestJSON-18703483 None] Create snapshot completed successfully Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-35a7123f-c804-4649-af60-9dd388d20df5-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-35a7123f-c804-4649-af60-9dd388d20df5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-35a7123f-c804-4649-af60-9dd388d20df5" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-35a7123f-c804-4649-af60-9dd388d20df5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Deleting offline snapshot 35a7123f-c804-4649-af60-9dd388d20df5 of volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] snapshot_file for this snap is: volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-1cb24013-6c1d-46b8-89ab-56dda4a2b154" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0454dee1-b4c6-4776-96c1-7d8734a21ad9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1cb24013-6c1d-46b8-89ab-56dda4a2b154" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Deleting offline snapshot e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a of volume 1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] snapshot_file for this snap is: volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0745985-d824-4e03-862d-21bc492cfd4c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:45 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:45 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:45 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a Jul 30 16:48:45 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:45 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.386s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e4d00-6b3b-4125-a878-c3e39c4b79a3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:45 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" returned: 0 in 0.367s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8c097-cb6a-4165-af92-8c6953c04cdc]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:45 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:45 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:45 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 Jul 30 16:48:45 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:46 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.367s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:46 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:46 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:46 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154" returned: 0 in 0.359s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:46 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a Jul 30 16:48:46 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:46 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.376s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:46 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:46 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5 Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:46 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:46 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a Jul 30 16:48:46 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:46 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.35a7123f-c804-4649-af60-9dd388d20df5" returned: 0 in 0.247s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:46 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154.e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" returned: 0 in 0.245s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-35a7123f-c804-4649-af60-9dd388d20df5" released by "_delete_snapshot" :: held 1.469s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" released by "delete_snapshot" :: held 1.499s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a" released by "_delete_snapshot" :: held 1.439s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1cb24013-6c1d-46b8-89ab-56dda4a2b154" released by "delete_snapshot" :: held 1.463s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Created reservations ['8dc72d6c-cf51-4b02-a088-323f378ed009', 'aa03af66-089e-4fe9-9d46-d94afe6ff7f2', 'e9af13d9-cd1d-440e-87b2-30e84164729d', 'e3a012ae-13a6-4795-92eb-eaef361cfcb1'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['0af9b21c-b7ca-4bb3-878f-9bb0945015ab', '1779772f-cd0e-4786-8a21-3d38bcd809ff', 'cc79b189-1762-4b0b-8e04-6d88723b5721', 'd9ccebae-7135-4119-a669-6c437f674fea'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Delete snapshot completed successfully. Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8a3c8118-7b48-4b67-9ab4-19c99a794760 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-35a7123f-c804-4649-af60-9dd388d20df5-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Delete snapshot completed successfully. Jul 30 16:48:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bac1fe46-7ae6-4730-90a2-2a9345c5dc53 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-e0f5ec39-d7cd-44c2-9b7f-fe4939f5989a-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-3fb42fd1-78ed-47a9-abd0-a01491b53536-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-3fb42fd1-78ed-47a9-abd0-a01491b53536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-3fb42fd1-78ed-47a9-abd0-a01491b53536" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-3fb42fd1-78ed-47a9-abd0-a01491b53536" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Deleting offline snapshot 3fb42fd1-78ed-47a9-abd0-a01491b53536 of volume a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] snapshot_file for this snap is: volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0273a914-4d71-49d8-9d1d-86b581107c7d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:47 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:47 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:47 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f64dcb-a858-4042-9632-585551c2195d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[590efcbf-5a7d-4804-9bae-0a272935ec04]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (21c9345e-f668-4f8b-84c1-6139ee4690f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4e0fe5-7d37-4268-86c5-46306377f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:47 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d Jul 30 16:48:47 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4e0fe5-7d37-4268-86c5-46306377f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1394485638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455912f7-9511-498a-95e3-c63bef16f35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:48Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac488021-fde1-4099-a6e5-c9f54365763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac488021-fde1-4099-a6e5-c9f54365763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4787f3a-2894-4a4a-961a-c4746dcd1e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4787f3a-2894-4a4a-961a-c4746dcd1e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '455912f7-9511-498a-95e3-c63bef16f35c', 'volume_name': 'volume-455912f7-9511-498a-95e3-c63bef16f35c', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d68bfd3-769d-420e-8e7d-e3ec02c3f894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d68bfd3-769d-420e-8e7d-e3ec02c3f894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d51cea-1507-4cd5-8da7-c77fab98e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Volume 455912f7-9511-498a-95e3-c63bef16f35c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-455912f7-9511-498a-95e3-c63bef16f35c', 'volume_size': 1} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1394485638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455912f7-9511-498a-95e3-c63bef16f35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:48Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Creating volume 455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:47 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:48:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:47 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c 1073741824 Jul 30 16:48:47 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:48 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:48 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:48 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:48 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c 1073741824" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:48 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c Jul 30 16:48:48 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:48 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.354s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:48 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536 Jul 30 16:48:48 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:48 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d51cea-1507-4cd5-8da7-c77fab98e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455912f7-9511-498a-95e3-c63bef16f35c', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2b4415-da61-4839-9e95-b6c932cf1886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:48 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Volume volume-455912f7-9511-498a-95e3-c63bef16f35c (455912f7-9511-498a-95e3-c63bef16f35c): created successfully Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2b4415-da61-4839-9e95-b6c932cf1886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (21c9345e-f668-4f8b-84c1-6139ee4690f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-82c5cd7b-c766-47e4-97a7-3b42d958dcf3 tempest-VolumesSnapshotTestJSON-18703483 None] Created volume successfully. Jul 30 16:48:48 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d.3fb42fd1-78ed-47a9-abd0-a01491b53536" returned: 0 in 0.237s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-3fb42fd1-78ed-47a9-abd0-a01491b53536" released by "_delete_snapshot" :: held 1.428s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" released by "delete_snapshot" :: held 1.459s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Created reservations ['6bf62fc7-ad50-4fbe-a809-fed21fa186b0', '613edb85-043c-48d5-a53f-3e3cd9f44861', '9326d9bf-46ca-4b3f-b606-37996e345b94', 'c652a825-f17c-4ba4-a354-223d0b36f079'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Delete snapshot completed successfully. Jul 30 16:48:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e923855e-a82f-458a-afea-047966068f42 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-3fb42fd1-78ed-47a9-abd0-a01491b53536-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Creating offline snapshot c63b0c1e-210b-4c1d-b34c-9442afa8c5bd of volume 455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee262d-8a98-42f4-8e5b-b8b84e68dbf4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c Jul 30 16:48:49 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:49 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c" returned: 0 in 0.358s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd 1G Jul 30 16:48:49 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-a6f64dcb-a858-4042-9632-585551c2195d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-a6f64dcb-a858-4042-9632-585551c2195d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38cba37-1014-40a0-8072-c591e1324fca]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d Jul 30 16:48:49 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:49 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd 1G" returned: 0 in 0.418s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455912f7-9511-498a-95e3-c63bef16f35c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:49 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455912f7-9511-498a-95e3-c63bef16f35c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd Jul 30 16:48:49 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d" returned: 0 in 0.362s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d Jul 30 16:48:50 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-455912f7-9511-498a-95e3-c63bef16f35c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd is being set with open permissions: ugo+rw Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd Jul 30 16:48:50 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a6f64dcb-a858-4042-9632-585551c2195d" returned: 0 in 0.244s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-quobyte-a6f64dcb-a858-4042-9632-585551c2195d" released by "delete_volume" :: held 0.664s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Created reservations ['55f67aa5-2331-4921-8f6b-eaafcac8bd60', 'da39cb4e-632f-4074-b7c1-55e008bb5a32', 'ca3f186f-07e3-43c6-9b99-f4d888e9c92f', '41161a81-9a41-4197-919c-7d5e032f0924'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:50 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" returned: 0 in 0.245s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:50 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:50 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:50 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info" returned: 0 in 0.269s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info is being set with open permissions: ugo+rw Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:50 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.261s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Deleted volume successfully. Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9d4d20e1-6a3f-44d6-86df-b016699deb73 tempest-VolumesSnapshotListTestJSON-1620942807 None] Lock "cinder-a6f64dcb-a858-4042-9632-585551c2195d-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:50 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.info" returned: 0 in 0.271s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-206e2104-8e59-4bac-bd13-7688f5ed1fdf tempest-VolumesSnapshotTestJSON-18703483 None] Create snapshot completed successfully Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (872bd616-3e15-44de-8019-2d641149b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba45bdb-1542-4e5c-a8c2-537832dd2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba45bdb-1542-4e5c-a8c2-537832dd2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1977807161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37539483-ca92-440e-ae5a-f9d5f052429a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:48:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c63b0c1e-210b-4c1d-b34c-9442afa8c5bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:48:52Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb52f2c7-36a5-437e-8c99-03fc61c41851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb52f2c7-36a5-437e-8c99-03fc61c41851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5174b5-fb8b-4ae8-907b-dab2be0c22d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5174b5-fb8b-4ae8-907b-dab2be0c22d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '37539483-ca92-440e-ae5a-f9d5f052429a', 'volume_name': 'volume-37539483-ca92-440e-ae5a-f9d5f052429a', 'volume_size': 2, 'snapshot_id': 'c63b0c1e-210b-4c1d-b34c-9442afa8c5bd'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5865f2d5-7ba0-455a-a92d-e7b637a782bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5865f2d5-7ba0-455a-a92d-e7b637a782bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97430002-4335-4cb6-a18e-bebea0683890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Volume 37539483-ca92-440e-ae5a-f9d5f052429a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-37539483-ca92-440e-ae5a-f9d5f052429a', 'volume_size': 2, 'snapshot_id': 'c63b0c1e-210b-4c1d-b34c-9442afa8c5bd'} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd-37539483-ca92-440e-ae5a-f9d5f052429a" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd-37539483-ca92-440e-ae5a-f9d5f052429a" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Creating volume 37539483-ca92-440e-ae5a-f9d5f052429a from snapshot c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-37539483-ca92-440e-ae5a-f9d5f052429a" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-37539483-ca92-440e-ae5a-f9d5f052429a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] snapshot: c63b0c1e-210b-4c1d-b34c-9442afa8c5bd, volume: 37539483-ca92-440e-ae5a-f9d5f052429a, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b765ff-12e4-45d0-83c9-82d5ab333c6d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:51 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd Jul 30 16:48:51 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:52 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-455912f7-9511-498a-95e3-c63bef16f35c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ddb4b-8b9a-4edf-ae04-0dc023cbfa2d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:52 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c Jul 30 16:48:52 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:52 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c" returned: 0 in 0.387s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:48:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:52 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a Jul 30 16:48:52 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:54 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:54 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:55 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.513s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:48:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:48:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:48:57 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a" returned: 0 in 4.686s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:48:57 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Converted 1024.00 MB image at 218.45 MB/s Jul 30 16:48:57 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a is being set with open permissions: ugo+rw Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:57 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a Jul 30 16:48:57 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:57 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-37539483-ca92-440e-ae5a-f9d5f052429a" released by "_copy_volume_from_snapshot" :: held 5.800s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd-37539483-ca92-440e-ae5a-f9d5f052429a" released by "_create_volume_from_snapshot" :: held 5.879s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.893s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97430002-4335-4cb6-a18e-bebea0683890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37539483-ca92-440e-ae5a-f9d5f052429a', 'volume_size': 2, 'snapshot_id': 'c63b0c1e-210b-4c1d-b34c-9442afa8c5bd'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ac898c-32b4-48ea-8655-1e9d72823d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:48:57 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Volume volume-37539483-ca92-440e-ae5a-f9d5f052429a (37539483-ca92-440e-ae5a-f9d5f052429a): created successfully Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ac898c-32b4-48ea-8655-1e9d72823d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:48:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (872bd616-3e15-44de-8019-2d641149b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:48:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-54b940fa-d800-4ff3-b5a3-754284708211 tempest-VolumesSnapshotTestJSON-18703483 None] Created volume successfully. Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-37539483-ca92-440e-ae5a-f9d5f052429a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-37539483-ca92-440e-ae5a-f9d5f052429a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-37539483-ca92-440e-ae5a-f9d5f052429a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-37539483-ca92-440e-ae5a-f9d5f052429a" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad581b98-f003-4435-8c4e-82b7ae240c72]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:58 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a Jul 30 16:48:58 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:58 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:58 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a Jul 30 16:48:58 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:59 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-37539483-ca92-440e-ae5a-f9d5f052429a" returned: 0 in 0.269s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-37539483-ca92-440e-ae5a-f9d5f052429a" released by "delete_volume" :: held 0.720s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['422e1b4d-a79d-4b2f-b322-2e584036949d', '38d190d8-ca38-49f4-beac-cbf5a0a90c1b', 'ba0f47a9-faa6-49a6-a644-5abbfeb64483', '9e89ccfd-8f1a-4d04-9448-bad248a54f07'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:59 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:48:59 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:59 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:48:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Deleted volume successfully. Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87a183ec-244f-4b02-b8b4-24ffc17cb01f tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-37539483-ca92-440e-ae5a-f9d5f052429a-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-455912f7-9511-498a-95e3-c63bef16f35c" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-455912f7-9511-498a-95e3-c63bef16f35c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Deleting offline snapshot c63b0c1e-210b-4c1d-b34c-9442afa8c5bd of volume 455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] snapshot_file for this snap is: volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb86af-01f8-41f1-a563-3cb31b6f2768]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:48:59 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd Jul 30 16:48:59 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:48:59 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" returned: 0 in 0.428s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:48:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-455912f7-9511-498a-95e3-c63bef16f35c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:49:00 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa451c0-ec74-4369-9032-8303e0d3b57f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:00 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c Jul 30 16:49:00 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:00 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c" returned: 0 in 0.583s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:00 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd Jul 30 16:49:00 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:00 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" returned: 0 in 0.380s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:01 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd Jul 30 16:49:01 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:01 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c.c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" returned: 0 in 0.267s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd" released by "_delete_snapshot" :: held 1.797s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-455912f7-9511-498a-95e3-c63bef16f35c" released by "delete_snapshot" :: held 1.825s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['9e71b248-5d63-41b0-9c13-e969443833c7', 'e34834f0-705c-4506-b968-67629ecfcb78', '2a3ee3a7-c565-4713-891d-6da4b7677ebe', '6ec5bdf9-66d3-49b2-bd77-98e03a4dd16a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Delete snapshot completed successfully. Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a4dc9fa2-068e-4a66-97ed-e5117613f553 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-c63b0c1e-210b-4c1d-b34c-9442afa8c5bd-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-455912f7-9511-498a-95e3-c63bef16f35c-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-455912f7-9511-498a-95e3-c63bef16f35c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-455912f7-9511-498a-95e3-c63bef16f35c" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-455912f7-9511-498a-95e3-c63bef16f35c" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d6749-1939-4fde-bc92-75a62e3bd161]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:02 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c Jul 30 16:49:02 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:02 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c" returned: 0 in 0.420s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:02 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c Jul 30 16:49:02 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:02 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-455912f7-9511-498a-95e3-c63bef16f35c" returned: 0 in 0.250s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-455912f7-9511-498a-95e3-c63bef16f35c" released by "delete_volume" :: held 0.750s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['4940ddbb-ab1f-481d-a90e-3b538d3d2225', '7a59c10d-245c-4937-8280-200defac7221', 'f6616c5c-085f-4ace-8471-fb72515a6a26', '750dd935-7e3a-40fa-a29d-41922972370b'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:02 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:02 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:02 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.261s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:02 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Deleted volume successfully. Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0f262d76-b3bd-463b-8aa3-62a3d4b4c34b tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-455912f7-9511-498a-95e3-c63bef16f35c-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (c0926cca-bdae-4114-bb0a-2e736d57a908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c1fda-4ac6-4139-9a8d-4dbca85f9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c1fda-4ac6-4139-9a8d-4dbca85f9431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524530896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c009bce-5867-4f9d-84fd-4384859ad5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:03Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98215fdf-eff1-48d9-bdae-9525f4ffefc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98215fdf-eff1-48d9-bdae-9525f4ffefc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abdcd80-899f-4f5a-adb0-af55a3cd37b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abdcd80-899f-4f5a-adb0-af55a3cd37b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c009bce-5867-4f9d-84fd-4384859ad5c4', 'volume_name': 'volume-1c009bce-5867-4f9d-84fd-4384859ad5c4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cd20b0-6e33-48e3-aa8e-3a57605ab419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cd20b0-6e33-48e3-aa8e-3a57605ab419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90145ef0-9745-4816-98a1-e7340b4d384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:03 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Volume 1c009bce-5867-4f9d-84fd-4384859ad5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c009bce-5867-4f9d-84fd-4384859ad5c4', 'volume_size': 1} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524530896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c009bce-5867-4f9d-84fd-4384859ad5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:03Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Creating volume 1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:03 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:49:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:03 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 1073741824 Jul 30 16:49:03 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:04 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 1073741824" returned: 0 in 0.553s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:04 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 Jul 30 16:49:04 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:04 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4" returned: 0 in 0.299s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90145ef0-9745-4816-98a1-e7340b4d384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c009bce-5867-4f9d-84fd-4384859ad5c4', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eb64ae-9eaa-4df0-9fa6-f78892026b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Volume volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 (1c009bce-5867-4f9d-84fd-4384859ad5c4): created successfully Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55eb64ae-9eaa-4df0-9fa6-f78892026b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (c0926cca-bdae-4114-bb0a-2e736d57a908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-922e31f3-85fa-417b-8e45-9b1fe9c28888 tempest-VolumesSnapshotTestJSON-18703483 None] Created volume successfully. Jul 30 16:49:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Creating offline snapshot 3d01455a-41be-4fc0-a046-288740dd15ab of volume 1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:49:05 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[af239cf4-423d-4efa-a255-0d0b24b16dfc]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:05 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 Jul 30 16:49:05 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:06 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4" returned: 0 in 0.357s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:06 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab 1G Jul 30 16:49:06 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:06 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab 1G" returned: 0 in 0.445s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:06 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab Jul 30 16:49:06 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:06 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:06 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab is being set with open permissions: ugo+rw Jul 30 16:49:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:06 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab Jul 30 16:49:06 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:07 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:07 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info Jul 30 16:49:07 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:07 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:07 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info is being set with open permissions: ugo+rw Jul 30 16:49:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:07 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info Jul 30 16:49:07 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:07 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.info" returned: 0 in 0.244s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a3ed68ba-b65a-4a08-884d-8d2b9095ccf2 tempest-VolumesSnapshotTestJSON-18703483 None] Create snapshot completed successfully Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (b82c51cd-b7f0-46bf-ba71-814122858945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4bf43f-765f-40f3-a08b-61d7cb2c6492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4bf43f-765f-40f3-a08b-61d7cb2c6492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1778956535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2d41f5-44ca-4099-96ec-d65b9e389900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b288008dc745a498a762afda39c487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d01455a-41be-4fc0-a046-288740dd15ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:08Z,use_quota=True,user_id='c4a51252ee0d4b0fa7a1062c343bb674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4129cbf1-0ac3-4367-88d5-a10c35108424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4129cbf1-0ac3-4367-88d5-a10c35108424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123d351c-9abf-4bc1-9c3d-52c7612ea186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123d351c-9abf-4bc1-9c3d-52c7612ea186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e2d41f5-44ca-4099-96ec-d65b9e389900', 'volume_name': 'volume-3e2d41f5-44ca-4099-96ec-d65b9e389900', 'volume_size': 1, 'snapshot_id': '3d01455a-41be-4fc0-a046-288740dd15ab'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6f6358-8f48-4999-a968-c656237ba70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6f6358-8f48-4999-a968-c656237ba70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32642693-dda4-4c12-a420-f524918155a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Volume 3e2d41f5-44ca-4099-96ec-d65b9e389900: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e2d41f5-44ca-4099-96ec-d65b9e389900', 'volume_size': 1, 'snapshot_id': '3d01455a-41be-4fc0-a046-288740dd15ab'} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-3d01455a-41be-4fc0-a046-288740dd15ab-3e2d41f5-44ca-4099-96ec-d65b9e389900" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3d01455a-41be-4fc0-a046-288740dd15ab-3e2d41f5-44ca-4099-96ec-d65b9e389900" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Creating volume 3e2d41f5-44ca-4099-96ec-d65b9e389900 from snapshot 3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-3e2d41f5-44ca-4099-96ec-d65b9e389900" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3e2d41f5-44ca-4099-96ec-d65b9e389900" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] snapshot: 3d01455a-41be-4fc0-a046-288740dd15ab, volume: 3e2d41f5-44ca-4099-96ec-d65b9e389900, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[177bdc41-787e-44b1-9bff-2ed417444223]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:08 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab Jul 30 16:49:08 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:09 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab" returned: 0 in 0.365s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c009bce-5867-4f9d-84fd-4384859ad5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[95788777-df87-4d10-aafb-f1c0e561cec8]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:09 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 Jul 30 16:49:09 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:09 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4" returned: 0 in 0.417s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:49:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:09 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 Jul 30 16:49:09 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:14 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900" returned: 0 in 5.024s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:49:14 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Converted 1024.00 MB image at 203.76 MB/s Jul 30 16:49:14 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 is being set with open permissions: ugo+rw Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:14 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 Jul 30 16:49:14 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:14 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900" returned: 0 in 0.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3e2d41f5-44ca-4099-96ec-d65b9e389900" released by "_copy_volume_from_snapshot" :: held 6.160s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3d01455a-41be-4fc0-a046-288740dd15ab-3e2d41f5-44ca-4099-96ec-d65b9e389900" released by "_create_volume_from_snapshot" :: held 6.234s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.255s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32642693-dda4-4c12-a420-f524918155a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2d41f5-44ca-4099-96ec-d65b9e389900', 'volume_size': 1, 'snapshot_id': '3d01455a-41be-4fc0-a046-288740dd15ab'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ebfd5c-584d-4d80-858c-57b855bd8c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Volume volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 (3e2d41f5-44ca-4099-96ec-d65b9e389900): created successfully Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ebfd5c-584d-4d80-858c-57b855bd8c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Flow 'volume_create_manager' (b82c51cd-b7f0-46bf-ba71-814122858945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f3154ba9-5cc7-4a56-86a7-9bfe3c79ea50 tempest-VolumesSnapshotTestJSON-18703483 None] Created volume successfully. Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-3e2d41f5-44ca-4099-96ec-d65b9e389900-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-3e2d41f5-44ca-4099-96ec-d65b9e389900-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-3e2d41f5-44ca-4099-96ec-d65b9e389900" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3e2d41f5-44ca-4099-96ec-d65b9e389900" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17bfb0e-6dbe-4914-90ae-c228941c2ad5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:15 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 Jul 30 16:49:15 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:15 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900" returned: 0 in 0.420s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:15 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900 Jul 30 16:49:15 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:15 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3e2d41f5-44ca-4099-96ec-d65b9e389900" returned: 0 in 0.247s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3e2d41f5-44ca-4099-96ec-d65b9e389900" released by "delete_volume" :: held 0.711s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:15 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['c80ea8b5-bda6-44cc-92f5-d86ae23c12d7', '9acbdb37-4022-4705-878c-8ed0e4ca8893', 'a56cdc75-71f9-4d00-ab43-43dad2b682da', '1892261e-7418-453a-9e9a-cb8df402bac7'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:16 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:16 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:16 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.239s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Deleted volume successfully. Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1e0a7253-fa7c-49c0-87fd-975df0839869 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-3e2d41f5-44ca-4099-96ec-d65b9e389900-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-3d01455a-41be-4fc0-a046-288740dd15ab-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-3d01455a-41be-4fc0-a046-288740dd15ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-1c009bce-5867-4f9d-84fd-4384859ad5c4" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1c009bce-5867-4f9d-84fd-4384859ad5c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-3d01455a-41be-4fc0-a046-288740dd15ab" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3d01455a-41be-4fc0-a046-288740dd15ab" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Deleting offline snapshot 3d01455a-41be-4fc0-a046-288740dd15ab of volume 1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] snapshot_file for this snap is: volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[05102fbc-984e-47f8-be08-d59439336712]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:16 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab Jul 30 16:49:16 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:16 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab" returned: 0 in 0.367s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c009bce-5867-4f9d-84fd-4384859ad5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862b928-c4f0-453d-9f45-c033bddc443f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:16 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 Jul 30 16:49:16 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:17 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4" returned: 0 in 0.546s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:17 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab Jul 30 16:49:17 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:17 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab" returned: 0 in 0.383s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:17 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab Jul 30 16:49:17 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:18 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4.3d01455a-41be-4fc0-a046-288740dd15ab" returned: 0 in 0.259s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=120,cinder:UPDATE=97,cinder:INSERT=31,cinder:DELETE=10 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=92,cinder:UPDATE=135,cinder:INSERT=29,cinder:DELETE=11 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-3d01455a-41be-4fc0-a046-288740dd15ab" released by "_delete_snapshot" :: held 1.666s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1c009bce-5867-4f9d-84fd-4384859ad5c4" released by "delete_snapshot" :: held 1.693s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['0e352609-43b9-461c-ba57-b6649156e724', 'af6fa1f2-98e2-4ca6-9a85-f61d48d8924a', 'fb5be588-f61a-47c4-a132-d04167a789f5', '119c4b46-eade-4fdc-807f-b445f929f0b1'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Delete snapshot completed successfully. Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-bafb319e-7ae9-4b0d-a490-c6eef4eaeccd tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-3d01455a-41be-4fc0-a046-288740dd15ab-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-1c009bce-5867-4f9d-84fd-4384859ad5c4-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-1c009bce-5867-4f9d-84fd-4384859ad5c4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-1c009bce-5867-4f9d-84fd-4384859ad5c4" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1c009bce-5867-4f9d-84fd-4384859ad5c4" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a48dab-6ea3-4cd8-bf83-9b9348595676]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:18 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 Jul 30 16:49:18 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:19 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4" returned: 0 in 0.438s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:19 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4 Jul 30 16:49:19 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:19 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1c009bce-5867-4f9d-84fd-4384859ad5c4" returned: 0 in 0.252s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1c009bce-5867-4f9d-84fd-4384859ad5c4" released by "delete_volume" :: held 0.766s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['01284efa-466f-4058-a484-531359f723d4', '8fb8ffb1-e697-45f4-a203-a4e1da5a0fef', 'faefbee6-ef93-419f-9b40-486faaa97362', 'aba3bf14-65eb-478c-a27c-882ee2699aab'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:19 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:19 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-1cb24013-6c1d-46b8-89ab-56dda4a2b154-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-1cb24013-6c1d-46b8-89ab-56dda4a2b154-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "cinder-quobyte-1cb24013-6c1d-46b8-89ab-56dda4a2b154" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1cb24013-6c1d-46b8-89ab-56dda4a2b154" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:20 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.337s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:20 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Deleted volume successfully. Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6c7205-7cf5-4995-ac77-6ebe937bd06d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-68b9b13b-bab4-4e7d-b53c-30d8b5acd2ab tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-1c009bce-5867-4f9d-84fd-4384859ad5c4-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:20 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 Jul 30 16:49:20 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:20 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154" returned: 0 in 0.385s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:20 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154 Jul 30 16:49:20 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:20 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1cb24013-6c1d-46b8-89ab-56dda4a2b154" returned: 0 in 0.262s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-quobyte-1cb24013-6c1d-46b8-89ab-56dda4a2b154" released by "delete_volume" :: held 0.729s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Created reservations ['3b52b666-b5e9-4aa6-9aa7-e8ebc7e8f4d9', '1cf5702b-0075-45ba-bcd5-738aadf68225', 'c4cbdac3-f1cd-4b7f-87ce-446e61b1c847', '6990ec92-7315-47ec-931e-12f7a72fcdf4'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:20 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:20 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:21 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.248s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:21 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Deleted volume successfully. Jul 30 16:49:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-97041650-68f0-484f-9a89-e2c4b29a7937 tempest-VolumesSnapshotTestJSON-18703483 None] Lock "cinder-1cb24013-6c1d-46b8-89ab-56dda4a2b154-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Flow 'volume_create_manager' (bd5b0c2e-4c64-4a53-a655-26a965c1a142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4144cc4b-615e-4e54-bc77-f5bf24543dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4144cc4b-615e-4e54-bc77-f5bf24543dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-321894475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e057ca6-45d9-4cdf-916f-2e3edc90ff8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e13d84f7a484087b9c7fb19970a0535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:28Z,use_quota=True,user_id='2630f0c25e5f46e4b7e9553e0c8b5e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9267795a-b521-48c6-9ec7-0abe91652827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9267795a-b521-48c6-9ec7-0abe91652827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1841e34-7338-4cb0-9de9-402889c16e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1841e34-7338-4cb0-9de9-402889c16e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e057ca6-45d9-4cdf-916f-2e3edc90ff8a', 'volume_name': 'volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a', 'volume_size': 2}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec79e7f6-8b37-46b1-9463-8dc8ad7c1626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec79e7f6-8b37-46b1-9463-8dc8ad7c1626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb6a76e-7092-4d42-926f-02396a5c394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:28 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Volume 0e057ca6-45d9-4cdf-916f-2e3edc90ff8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a', 'volume_size': 2} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-321894475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e057ca6-45d9-4cdf-916f-2e3edc90ff8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e13d84f7a484087b9c7fb19970a0535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:28Z,use_quota=True,user_id='2630f0c25e5f46e4b7e9553e0c8b5e35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Creating volume 0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:28 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a 2147483648 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:28 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a 2147483648 Jul 30 16:49:28 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:28 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a 2147483648" returned: 0 in 0.452s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:29 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a Jul 30 16:49:29 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:29 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" returned: 0 in 0.228s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb6a76e-7092-4d42-926f-02396a5c394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a', 'volume_size': 2}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd0511-e647-4eef-8109-37c7c7ae1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:29 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Volume volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a (0e057ca6-45d9-4cdf-916f-2e3edc90ff8a): created successfully Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bd0511-e647-4eef-8109-37c7c7ae1e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Flow 'volume_create_manager' (bd5b0c2e-4c64-4a53-a655-26a965c1a142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:29 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-54888585-e600-4bb8-bcd0-ccccc8093e30 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Created volume successfully. Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Creating offline snapshot eb559402-b4e6-4a20-9d3a-b6bfb70264b3 of volume 0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[af40f7c3-c36d-4482-8572-e5626630ba66]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:29 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a Jul 30 16:49:29 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:29 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" returned: 0 in 0.350s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 2G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:30 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 2G Jul 30 16:49:30 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:30 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 2G" returned: 0 in 0.360s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:30 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 Jul 30 16:49:30 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:30 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3" returned: 0 in 0.282s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:30 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 is being set with open permissions: ugo+rw Jul 30 16:49:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:30 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 Jul 30 16:49:30 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:30 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3" returned: 0 in 0.231s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:30 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info Jul 30 16:49:30 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:31 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info" returned: 0 in 0.240s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:31 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info is being set with open permissions: ugo+rw Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:31 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info Jul 30 16:49:31 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:31 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.info" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3456246a-d34e-42ec-8324-cdecff7c3e90 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Create snapshot completed successfully Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "cinder-eb559402-b4e6-4a20-9d3a-b6bfb70264b3-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-eb559402-b4e6-4a20-9d3a-b6bfb70264b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "cinder-quobyte-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-quobyte-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "cinder-quobyte-eb559402-b4e6-4a20-9d3a-b6bfb70264b3" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-quobyte-eb559402-b4e6-4a20-9d3a-b6bfb70264b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Deleting offline snapshot eb559402-b4e6-4a20-9d3a-b6bfb70264b3 of volume 0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] snapshot_file for this snap is: volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3235803-06f1-4293-96e3-8cf9a73eefb6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:31 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 Jul 30 16:49:31 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:32 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866739c-4b30-4f33-a571-27914898c6db]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:32 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a Jul 30 16:49:32 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:32 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" returned: 0 in 0.354s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:32 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 Jul 30 16:49:32 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:32 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3" returned: 0 in 0.351s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:32 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3 Jul 30 16:49:32 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:33 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a.eb559402-b4e6-4a20-9d3a-b6bfb70264b3" returned: 0 in 0.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-quobyte-eb559402-b4e6-4a20-9d3a-b6bfb70264b3" released by "_delete_snapshot" :: held 1.413s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-quobyte-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" released by "delete_snapshot" :: held 1.437s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:33 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Created reservations ['08fbd25c-f3be-41a1-9562-320bc7f80330', '7c0a1982-691c-4f79-87e1-8897a9ea4cf2', '70ea4590-3f02-453d-964f-e0718a844970', 'ab61652c-6420-4d8c-a134-de3af30755ee'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Delete snapshot completed successfully. Jul 30 16:49:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00b4d7b3-a68f-4ecb-bc62-6dc3582efcde tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-eb559402-b4e6-4a20-9d3a-b6bfb70264b3-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "cinder-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "cinder-quobyte-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-quobyte-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec898a33-499e-46d0-bba7-7d16223fde01]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:34 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a Jul 30 16:49:34 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:34 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" returned: 0 in 0.379s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:34 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a Jul 30 16:49:34 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:34 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" returned: 0 in 0.243s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-quobyte-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a" released by "delete_volume" :: held 0.692s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Created reservations ['cd4930f7-33a1-4b38-ab33-4f44c35191ce', '71fe63c4-0210-4b38-a0c4-5b81683bd108', '31204f70-d725-4985-8bf4-14a2743fc994', '6256ad1e-461e-4eb8-8f3a-717a10097567'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:34 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:34 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:35 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:35 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Deleted volume successfully. Jul 30 16:49:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de5e4d70-432a-4c9b-9932-6a39598843e3 tempest-VolumesSnapshotNegativeTestJSON-1802923259 None] Lock "cinder-0e057ca6-45d9-4cdf-916f-2e3edc90ff8a-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Flow 'volume_create_manager' (c2bee18d-bcd6-472f-a962-f62efe5503fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe317bf-97be-4de3-af1d-9504191b4934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe317bf-97be-4de3-af1d-9504191b4934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1556862517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe856749-ae31-4c63-8394-8052f3e613d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a096b95189473eb706e59c921e06ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:46Z,use_quota=True,user_id='e0e7d8818e6343f3859d6f360aa03298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de88c0c-6a04-4b11-989f-be9525ba26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de88c0c-6a04-4b11-989f-be9525ba26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d3f6e-2a4b-4818-af76-b64b57e3c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2d3f6e-2a4b-4818-af76-b64b57e3c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe856749-ae31-4c63-8394-8052f3e613d2', 'volume_name': 'volume-fe856749-ae31-4c63-8394-8052f3e613d2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90349a94-fadf-43d4-9528-1ab82c9b8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90349a94-fadf-43d4-9528-1ab82c9b8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03066f-4a3b-4fab-8753-0370da4221dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Volume fe856749-ae31-4c63-8394-8052f3e613d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe856749-ae31-4c63-8394-8052f3e613d2', 'volume_size': 1} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1556862517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe856749-ae31-4c63-8394-8052f3e613d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a096b95189473eb706e59c921e06ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:49:46Z,use_quota=True,user_id='e0e7d8818e6343f3859d6f360aa03298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Creating volume fe856749-ae31-4c63-8394-8052f3e613d2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:49:46 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:46 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 1073741824 Jul 30 16:49:46 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:46 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 1073741824" returned: 0 in 0.513s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:47 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 Jul 30 16:49:47 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:47 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2" returned: 0 in 0.261s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03066f-4a3b-4fab-8753-0370da4221dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe856749-ae31-4c63-8394-8052f3e613d2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fe7dca-6a28-471f-a867-6c76cff385ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:49:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Volume volume-fe856749-ae31-4c63-8394-8052f3e613d2 (fe856749-ae31-4c63-8394-8052f3e613d2): created successfully Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fe7dca-6a28-471f-a867-6c76cff385ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:49:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Flow 'volume_create_manager' (c2bee18d-bcd6-472f-a962-f62efe5503fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:49:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-37504413-0d6c-4454-81c9-bea49407b487 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Created volume successfully. Jul 30 16:49:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-7b3c92a1-6e41-4d3d-a6a1-c69eefa43e8a req-6e378df4-e3ab-4b66-a373-953bd06f55a1 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-7b3c92a1-6e41-4d3d-a6a1-c69eefa43e8a req-6e378df4-e3ab-4b66-a373-953bd06f55a1 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-7b3c92a1-6e41-4d3d-a6a1-c69eefa43e8a req-6e378df4-e3ab-4b66-a373-953bd06f55a1 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-7b3c92a1-6e41-4d3d-a6a1-c69eefa43e8a req-6e378df4-e3ab-4b66-a373-953bd06f55a1 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-fe856749-ae31-4c63-8394-8052f3e613d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ed83066-0c26-49be-8326-9ab414a028d4', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:49:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-7b3c92a1-6e41-4d3d-a6a1-c69eefa43e8a req-6e378df4-e3ab-4b66-a373-953bd06f55a1 tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] attachment_update completed successfully. Jul 30 16:49:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-f7acaa70-4a36-496b-80f7-593528dc1758 req-b0ae7778-3e23-43e2-a8b5-5ddbd511e08e tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Terminate volume connection completed successfully. Jul 30 16:49:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-f7acaa70-4a36-496b-80f7-593528dc1758 req-b0ae7778-3e23-43e2-a8b5-5ddbd511e08e tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Deleting attachment 9ed83066-0c26-49be-8326-9ab414a028d4. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:49:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Acquiring lock "cinder-fe856749-ae31-4c63-8394-8052f3e613d2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "cinder-fe856749-ae31-4c63-8394-8052f3e613d2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Acquiring lock "cinder-quobyte-fe856749-ae31-4c63-8394-8052f3e613d2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:49:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "cinder-quobyte-fe856749-ae31-4c63-8394-8052f3e613d2" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:49:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f844bb-82b6-4768-8ada-2f2c4fce9f8d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:49:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:53 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 Jul 30 16:49:53 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:54 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:54 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2 Jul 30 16:49:54 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:54 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe856749-ae31-4c63-8394-8052f3e613d2" returned: 0 in 0.274s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "cinder-quobyte-fe856749-ae31-4c63-8394-8052f3e613d2" released by "delete_volume" :: held 0.741s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Created reservations ['b454fb14-70a7-4047-9a7f-d8cd47b1e601', '17b7af26-1428-4438-bff0-c0459253cad7', 'de8a5cc9-e1d3-4e5f-a465-4f03363d03b1', '53c23139-cd91-41a9-a409-4b6514a0454d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:54 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:54 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:49:54 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:49:54 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:49:54 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Deleted volume successfully. Jul 30 16:49:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1f7db0e1-b67b-430b-8797-3fd153fbde9b tempest-TestServerVolumeAttachScenarioOldVersion-35340694 None] Lock "cinder-fe856749-ae31-4c63-8394-8052f3e613d2-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:49:55 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 30 16:49:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.441s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:49:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:49:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:49:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:49:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Flow 'volume_create_manager' (9b6826d0-2975-4e54-906a-61db851c93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457ff40-48f2-4c63-ac05-2b5fd0930bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457ff40-48f2-4c63-ac05-2b5fd0930bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-179728373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a02b9f0214187b5d2ebb41f25b692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:02Z,use_quota=True,user_id='6f4c0e1acea64aaf929fb331729309b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf72cf-137c-4b40-b541-d9d12d7f770c),volume_type_id=00cf72cf-137c-4b40-b541-d9d12d7f770c)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97bf6be-09a1-458d-9d22-fa5b6e2ba28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97bf6be-09a1-458d-9d22-fa5b6e2ba28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24493f5e-db0c-4477-ac00-1fa2f7b778d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24493f5e-db0c-4477-ac00-1fa2f7b778d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0', 'volume_name': 'volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2c96a7-0fd8-407f-a32d-131a8d564f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2c96a7-0fd8-407f-a32d-131a8d564f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d7c426-128d-4d9f-8f8b-2cb80519bde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:01 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume 9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0', 'volume_size': 1} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-179728373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a02b9f0214187b5d2ebb41f25b692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:02Z,use_quota=True,user_id='6f4c0e1acea64aaf929fb331729309b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00cf72cf-137c-4b40-b541-d9d12d7f770c),volume_type_id=00cf72cf-137c-4b40-b541-d9d12d7f770c)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Creating volume 9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:01 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:50:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:01 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 1073741824 Jul 30 16:50:01 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Flow 'volume_create_manager' (004790f7-f7e4-4856-ac5d-f16badd6085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3895cc50-552a-4421-93f3-a6e52c83c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3895cc50-552a-4421-93f3-a6e52c83c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-345057314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38dfb09-cb91-44de-bef3-a34a8a0b5e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a02b9f0214187b5d2ebb41f25b692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:02Z,use_quota=True,user_id='6f4c0e1acea64aaf929fb331729309b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89081747-2689-431c-9ad0-4862d93bc5fd),volume_type_id=89081747-2689-431c-9ad0-4862d93bc5fd)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc066ad-bbab-4476-9f07-27a5e6b3dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc066ad-bbab-4476-9f07-27a5e6b3dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581ccd89-34cb-4b8f-83cc-2bb6a217a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581ccd89-34cb-4b8f-83cc-2bb6a217a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38dfb09-cb91-44de-bef3-a34a8a0b5e9a', 'volume_name': 'volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1c9b47-f205-4cf5-a31f-cfbbe87acd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1c9b47-f205-4cf5-a31f-cfbbe87acd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bdd4bd-6872-4e73-ae37-4e440f208aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume b38dfb09-cb91-44de-bef3-a34a8a0b5e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a', 'volume_size': 1} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:02 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 1073741824" returned: 0 in 0.542s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:02 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 Jul 30 16:50:02 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:02 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0" returned: 0 in 0.358s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-345057314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38dfb09-cb91-44de-bef3-a34a8a0b5e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a02b9f0214187b5d2ebb41f25b692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:02Z,use_quota=True,user_id='6f4c0e1acea64aaf929fb331729309b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89081747-2689-431c-9ad0-4862d93bc5fd),volume_type_id=89081747-2689-431c-9ad0-4862d93bc5fd)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Creating volume b38dfb09-cb91-44de-bef3-a34a8a0b5e9a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:02 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d7c426-128d-4d9f-8f8b-2cb80519bde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:02 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a 1073741824 Jul 30 16:50:02 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c614db1-d66f-4e89-97ed-7ad371e4a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Flow 'volume_create_manager' (7eac7ae1-a1c2-4613-98ea-43639b4807b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de13299-f8aa-43cf-9e25-fbfae5ae394b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:02 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 (9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0): created successfully Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c614db1-d66f-4e89-97ed-7ad371e4a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Flow 'volume_create_manager' (9b6826d0-2975-4e54-906a-61db851c93e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de13299-f8aa-43cf-9e25-fbfae5ae394b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2034642244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0654aeea-ed8d-4b72-9c32-d35bd101fc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a02b9f0214187b5d2ebb41f25b692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:03Z,use_quota=True,user_id='6f4c0e1acea64aaf929fb331729309b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52403bdc-4533-4b22-bae1-7d2bca385e88),volume_type_id=52403bdc-4533-4b22-bae1-7d2bca385e88)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1405eef-301f-4f6f-af19-1e7ca81da8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1405eef-301f-4f6f-af19-1e7ca81da8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62db7079-ef50-4ad5-8294-cb5a0437ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:50:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e757c5d8-b3c3-4de3-a8eb-fec70f5b0f3b tempest-TestInstancesWithCinderVolumes-1855727743 None] Created volume successfully. Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62db7079-ef50-4ad5-8294-cb5a0437ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0654aeea-ed8d-4b72-9c32-d35bd101fc78', 'volume_name': 'volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78', 'volume_size': 1, 'image_id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1843532964', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a87a02b9f0214187b5d2ebb41f25b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'created_at': datetime.datetime(2026, 7, 30, 14, 49, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 50, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55/file', 'properties': {}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23e9182-eda0-45b9-bc8c-32a2e162c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23e9182-eda0-45b9-bc8c-32a2e162c067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4cb904-b7aa-4d87-b40a-12f13dcd6654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:03 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume 0654aeea-ed8d-4b72-9c32-d35bd101fc78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78', 'volume_size': 1, 'image_id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1843532964', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a87a02b9f0214187b5d2ebb41f25b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'created_at': datetime.datetime(2026, 7, 30, 14, 49, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 50, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55/file', 'properties': {}}, 'image_service': } Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Trying to clone 0654aeea-ed8d-4b72-9c32-d35bd101fc78 from image 87381108-34f2-4caf-9fa8-c6adc8ec4f55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:50:03 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a 1073741824" returned: 0 in 0.445s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:03 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a Jul 30 16:50:03 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:03 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a" returned: 0 in 0.302s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2bdd4bd-6872-4e73-ae37-4e440f208aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c137db-2147-46d0-bdbd-72a7fd24afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:03 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a (b38dfb09-cb91-44de-bef3-a34a8a0b5e9a): created successfully Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c137db-2147-46d0-bdbd-72a7fd24afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Flow 'volume_create_manager' (004790f7-f7e4-4856-ac5d-f16badd6085d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-23196976-7a99-47dd-a8be-20b9c63d1608 tempest-TestInstancesWithCinderVolumes-1855727743 None] Created volume successfully. Jul 30 16:50:06 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD, size 20.69 MB, duration 3.30 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:50:06 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Image download 20.69 MB at 6.27 MB/s Jul 30 16:50:06 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ba773-2b46-4c74-91bb-0e8f6c90fd59]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:06 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD Jul 30 16:50:06 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:07 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Temporary image 87381108-34f2-4caf-9fa8-c6adc8ec4f55 is fetched for user 6f4c0e1acea64aaf929fb331729309b4. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5383b2b-4427-43d2-8043-9ea4612fd2cf]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:07 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD Jul 30 16:50:07 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:07 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2034642244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0654aeea-ed8d-4b72-9c32-d35bd101fc78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87a02b9f0214187b5d2ebb41f25b692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:50:03Z,use_quota=True,user_id='6f4c0e1acea64aaf929fb331729309b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52403bdc-4533-4b22-bae1-7d2bca385e88),volume_type_id=52403bdc-4533-4b22-bae1-7d2bca385e88)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Creating volume 0654aeea-ed8d-4b72-9c32-d35bd101fc78 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:50:07 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:50:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:07 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 1073741824 Jul 30 16:50:07 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:08 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 1073741824" returned: 0 in 0.499s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:08 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 Jul 30 16:50:08 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:08 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Attempting download of 87381108-34f2-4caf-9fa8-c6adc8ec4f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'metadata': {}}])) to volume 0654aeea-ed8d-4b72-9c32-d35bd101fc78. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3efb017-0966-44b0-8ad6-debfb23cc0a1]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:08 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq Jul 30 16:50:08 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:08 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq" returned: 0 in 0.353s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:08 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq Jul 30 16:50:08 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:09 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq" returned: 1 in 0.333s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87381108-34f2-4caf-9fa8-c6adc8ec4f55_x91hhlhq' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945ebe9-ccab-4d58-8c13-ef1e18ec1d5d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:09 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD Jul 30 16:50:09 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:09 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] 87381108-34f2-4caf-9fa8-c6adc8ec4f55 was qcow2, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:50:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:09 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 Jul 30 16:50:09 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:11 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78" returned: 0 in 1.931s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87381108-34f2-4caf-9fa8-c6adc8ec4f55_mbklqkhtdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:50:11 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Converted 112.00 MB image at 57.96 MB/s Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:11 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 1G Jul 30 16:50:11 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:11 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 1G" returned: 0 in 0.316s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Downloaded image 87381108-34f2-4caf-9fa8-c6adc8ec4f55 ((None, [{'url': 'file:///opt/stack/data/glance/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'metadata': {}}])) to volume 0654aeea-ed8d-4b72-9c32-d35bd101fc78 successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Temporary image 87381108-34f2-4caf-9fa8-c6adc8ec4f55 for user 6f4c0e1acea64aaf929fb331729309b4 is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Marking volume 0654aeea-ed8d-4b72-9c32-d35bd101fc78 as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Copying metadata from image 87381108-34f2-4caf-9fa8-c6adc8ec4f55 to 0654aeea-ed8d-4b72-9c32-d35bd101fc78. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Creating volume glance metadata for volume 0654aeea-ed8d-4b72-9c32-d35bd101fc78 backed by image 87381108-34f2-4caf-9fa8-c6adc8ec4f55 with: {'image_id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'image_name': 'tempest-scenario-img--1843532964', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4cb904-b7aa-4d87-b40a-12f13dcd6654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78', 'volume_size': 1, 'image_id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1843532964', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a87a02b9f0214187b5d2ebb41f25b692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '87381108-34f2-4caf-9fa8-c6adc8ec4f55', 'created_at': datetime.datetime(2026, 7, 30, 14, 49, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 50, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87381108-34f2-4caf-9fa8-c6adc8ec4f55/file', 'properties': {}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0433b20f-c2d5-402e-a5c8-c2a67fa3614c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:50:11 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Volume volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 (0654aeea-ed8d-4b72-9c32-d35bd101fc78): created successfully Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0433b20f-c2d5-402e-a5c8-c2a67fa3614c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:50:11 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Flow 'volume_create_manager' (7eac7ae1-a1c2-4613-98ea-43639b4807b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:50:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-85a835eb-8cb8-4a2d-b300-11aec1a4c677 tempest-TestInstancesWithCinderVolumes-1855727743 None] Created volume successfully. Jul 30 16:50:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-716986d0-9be4-4be2-a722-3685c7a5cf3d req-e2e1a5a6-130c-44c2-a6ed-bee179e4aad9 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-716986d0-9be4-4be2-a722-3685c7a5cf3d req-e2e1a5a6-130c-44c2-a6ed-bee179e4aad9 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-716986d0-9be4-4be2-a722-3685c7a5cf3d req-e2e1a5a6-130c-44c2-a6ed-bee179e4aad9 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:15 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-716986d0-9be4-4be2-a722-3685c7a5cf3d req-e2e1a5a6-130c-44c2-a6ed-bee179e4aad9 tempest-TestInstancesWithCinderVolumes-1855727743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22d2c513-a026-4ab3-984f-2e740953c678', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:50:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-716986d0-9be4-4be2-a722-3685c7a5cf3d req-e2e1a5a6-130c-44c2-a6ed-bee179e4aad9 tempest-TestInstancesWithCinderVolumes-1855727743 None] attachment_update completed successfully. Jul 30 16:50:25 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=65,cinder:INSERT=21,cinder:UPDATE=61,cinder:DELETE=7 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:25 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=62,cinder:INSERT=18,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:50:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-91e91ded-a4fc-4ba9-9a0e-a2250d1f241e req-523b5e8e-c7d0-4890-a5e4-c0c4e7b63ee7 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-91e91ded-a4fc-4ba9-9a0e-a2250d1f241e req-523b5e8e-c7d0-4890-a5e4-c0c4e7b63ee7 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-91e91ded-a4fc-4ba9-9a0e-a2250d1f241e req-523b5e8e-c7d0-4890-a5e4-c0c4e7b63ee7 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-91e91ded-a4fc-4ba9-9a0e-a2250d1f241e req-523b5e8e-c7d0-4890-a5e4-c0c4e7b63ee7 tempest-TestInstancesWithCinderVolumes-1855727743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d38f9c9-2bc7-4b8f-b212-92d77ee25487', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:50:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-91e91ded-a4fc-4ba9-9a0e-a2250d1f241e req-523b5e8e-c7d0-4890-a5e4-c0c4e7b63ee7 tempest-TestInstancesWithCinderVolumes-1855727743 None] attachment_update completed successfully. Jul 30 16:50:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-31f13fbf-4309-4253-a5ca-e04f2d3dcfd0 req-62f33b34-8c22-4a0c-89da-a34f008705be tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-31f13fbf-4309-4253-a5ca-e04f2d3dcfd0 req-62f33b34-8c22-4a0c-89da-a34f008705be tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-31f13fbf-4309-4253-a5ca-e04f2d3dcfd0 req-62f33b34-8c22-4a0c-89da-a34f008705be tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-31f13fbf-4309-4253-a5ca-e04f2d3dcfd0 req-62f33b34-8c22-4a0c-89da-a34f008705be tempest-TestInstancesWithCinderVolumes-1855727743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f823aaea-eb7c-4fa8-961e-203e75e3444a', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:50:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-31f13fbf-4309-4253-a5ca-e04f2d3dcfd0 req-62f33b34-8c22-4a0c-89da-a34f008705be tempest-TestInstancesWithCinderVolumes-1855727743 None] attachment_update completed successfully. Jul 30 16:50:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-7e9045a8-cdb3-42d9-baef-4fd7992ecb5c req-a721eb9c-5794-4e2f-a51e-a023c941f203 tempest-TestInstancesWithCinderVolumes-1855727743 None] Terminate volume connection completed successfully. Jul 30 16:50:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-7e9045a8-cdb3-42d9-baef-4fd7992ecb5c req-a721eb9c-5794-4e2f-a51e-a023c941f203 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deleting attachment 1d38f9c9-2bc7-4b8f-b212-92d77ee25487. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "cinder-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "cinder-quobyte-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-quobyte-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aebcd0-dcba-453d-b708-1a06a73773a9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:53 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 Jul 30 16:50:53 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:53 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0" returned: 0 in 0.371s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:53 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0 Jul 30 16:50:53 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:54 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-quobyte-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0" released by "delete_volume" :: held 0.678s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:54 devstack cinder-volume[88380]: WARNING cinder.quota [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39854922-577868224 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39854922-577868224, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:50:54 devstack cinder-volume[88380]: WARNING cinder.quota [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39854922-577868224 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-39854922-577868224, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Created reservations ['8a087755-ae3a-49f1-9269-0054f4de4d8d', '749265eb-c37b-4c21-8419-17087f209f64', '98d191b6-ff05-45f0-874a-c4c68e75bc25', '1448eb15-f3a1-4e91-957a-70f8f2d31e0b'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:54 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:50:54 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:54 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deleted volume successfully. Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-38959f7f-37f5-4b3a-8db8-5960ec7e67e3 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-9d85c80c-9354-4fe6-9e4c-5a5f1d8b9ca0-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:54 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:50:54 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:54 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.241s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:50:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:50:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-cd75869e-d645-4580-9fcc-07c5f4979b78 req-7a0980d9-be99-46fc-a36f-b9404b90cffe tempest-TestInstancesWithCinderVolumes-1855727743 None] Terminate volume connection completed successfully. Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-cd75869e-d645-4580-9fcc-07c5f4979b78 req-7a0980d9-be99-46fc-a36f-b9404b90cffe tempest-TestInstancesWithCinderVolumes-1855727743 None] Deleting attachment f823aaea-eb7c-4fa8-961e-203e75e3444a. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "cinder-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "cinder-quobyte-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-quobyte-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeccc14-8d50-4786-8fd5-2fa6df3ca4c0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:50:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:58 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a Jul 30 16:50:58 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:58 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a" returned: 0 in 0.356s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:58 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a Jul 30 16:50:58 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:58 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-quobyte-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a" released by "delete_volume" :: held 0.653s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:50:58 devstack cinder-volume[88380]: WARNING cinder.quota [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72949899-663558947 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72949899-663558947, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:50:58 devstack cinder-volume[88380]: WARNING cinder.quota [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72949899-663558947 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-72949899-663558947, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Created reservations ['d2acc31b-a717-4cfc-9b0a-a3a85e5cd007', '1c72a25e-1286-4ef9-94ef-a766771f4d67', '488991ae-35df-48f9-9bb5-aedd402b9a48', '21bb0f54-c44a-44c2-8bc7-b30e9212f666'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:50:58 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:50:58 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:50:58 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:50:58 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Deleted volume successfully. Jul 30 16:50:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-1279a5fa-2f8b-40b5-98a5-76629f5b18aa tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-b38dfb09-cb91-44de-bef3-a34a8a0b5e9a-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-cd306ba7-d8e9-4591-9efd-3858b732a7fb req-75ed9e0a-b6f5-4f65-939b-fb9ccbf87e8e tempest-TestInstancesWithCinderVolumes-1855727743 None] Terminate volume connection completed successfully. Jul 30 16:51:01 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-cd306ba7-d8e9-4591-9efd-3858b732a7fb req-75ed9e0a-b6f5-4f65-939b-fb9ccbf87e8e tempest-TestInstancesWithCinderVolumes-1855727743 None] Deleting attachment 22d2c513-a026-4ab3-984f-2e740953c678. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:51:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "cinder-0654aeea-ed8d-4b72-9c32-d35bd101fc78-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-0654aeea-ed8d-4b72-9c32-d35bd101fc78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "cinder-quobyte-0654aeea-ed8d-4b72-9c32-d35bd101fc78" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:51:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-quobyte-0654aeea-ed8d-4b72-9c32-d35bd101fc78" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:51:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f01fa69-b2b4-4711-b7a8-1c692c9b03f3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:51:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:03 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 Jul 30 16:51:03 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:03 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78" returned: 0 in 0.343s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:03 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78 Jul 30 16:51:03 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:03 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0654aeea-ed8d-4b72-9c32-d35bd101fc78" returned: 0 in 0.248s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-quobyte-0654aeea-ed8d-4b72-9c32-d35bd101fc78" released by "delete_volume" :: held 0.628s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:03 devstack cinder-volume[88380]: WARNING cinder.quota [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83830613-1655674185 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83830613-1655674185, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:51:03 devstack cinder-volume[88380]: WARNING cinder.quota [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83830613-1655674185 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83830613-1655674185, it is now deprecated. Please use the default quota class for default quota. Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Created reservations ['cd9d2d1a-619b-467e-a797-c4c0f0820229', '57da81fe-4d10-48e2-b78d-6d904de2524f', '1ff756fb-566d-4c00-8d04-7256064d2345', '39260761-b61a-4567-b699-8d4386e1be4f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:03 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:51:03 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:03 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.242s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Deleted volume successfully. Jul 30 16:51:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c8ec3edf-c225-419f-a7af-26c6034a9413 tempest-TestInstancesWithCinderVolumes-1855727743 None] Lock "cinder-0654aeea-ed8d-4b72-9c32-d35bd101fc78-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:51:13 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=35,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:13 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Flow 'volume_create_manager' (22fbcaae-dea7-4183-a7da-a7f7573d6f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14e4bd0-f245-4ca9-8c56-a04175d10eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14e4bd0-f245-4ca9-8c56-a04175d10eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1848074309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c4d606-855a-4c67-907a-29bf04695524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1717a7c551ee49209633f3e48a778ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:44Z,use_quota=True,user_id='476f4a8276744b50aacd21051072ab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff7c6d-93eb-46f3-a458-2208dad09a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff7c6d-93eb-46f3-a458-2208dad09a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebceaa41-f1dd-47ce-b558-ddc718bd17b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebceaa41-f1dd-47ce-b558-ddc718bd17b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c4d606-855a-4c67-907a-29bf04695524', 'volume_name': 'volume-88c4d606-855a-4c67-907a-29bf04695524', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510e727d-8b98-4ca4-9d46-bf9eece15a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510e727d-8b98-4ca4-9d46-bf9eece15a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a0247c-8122-47f1-93f7-2f710c90edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Volume 88c4d606-855a-4c67-907a-29bf04695524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c4d606-855a-4c67-907a-29bf04695524', 'volume_size': 1} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1848074309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c4d606-855a-4c67-907a-29bf04695524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1717a7c551ee49209633f3e48a778ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:51:44Z,use_quota=True,user_id='476f4a8276744b50aacd21051072ab9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Creating volume 88c4d606-855a-4c67-907a-29bf04695524 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:51:44 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:51:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:44 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 1073741824 Jul 30 16:51:44 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:45 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 1073741824" returned: 0 in 0.429s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:45 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 Jul 30 16:51:45 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:45 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524" returned: 0 in 0.235s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a0247c-8122-47f1-93f7-2f710c90edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c4d606-855a-4c67-907a-29bf04695524', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4fb366-fdc9-4b66-80b5-6d791f16e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:51:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Volume volume-88c4d606-855a-4c67-907a-29bf04695524 (88c4d606-855a-4c67-907a-29bf04695524): created successfully Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4fb366-fdc9-4b66-80b5-6d791f16e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:51:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Flow 'volume_create_manager' (22fbcaae-dea7-4183-a7da-a7f7573d6f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:51:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3ce413ca-3393-451d-b727-05cd8f09d3da tempest-TestMinimumBasicScenario-1354421378 None] Created volume successfully. Jul 30 16:51:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-44ef41b1-e0a6-4f97-89a4-526c8c3dc3ec req-676f2481-b73a-4cde-ba49-55de1321b8fd tempest-TestMinimumBasicScenario-1354421378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-44ef41b1-e0a6-4f97-89a4-526c8c3dc3ec req-676f2481-b73a-4cde-ba49-55de1321b8fd tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [req-44ef41b1-e0a6-4f97-89a4-526c8c3dc3ec req-676f2481-b73a-4cde-ba49-55de1321b8fd tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-44ef41b1-e0a6-4f97-89a4-526c8c3dc3ec req-676f2481-b73a-4cde-ba49-55de1321b8fd tempest-TestMinimumBasicScenario-1354421378 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763', 'name': 'volume-88c4d606-855a-4c67-907a-29bf04695524', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f42fa63-aded-4913-aee7-40a278ea8167', 'enforce_multipath': True} {{(pid=88380) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 30 16:51:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-44ef41b1-e0a6-4f97-89a4-526c8c3dc3ec req-676f2481-b73a-4cde-ba49-55de1321b8fd tempest-TestMinimumBasicScenario-1354421378 None] attachment_update completed successfully. Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:51:54 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:51:54 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:51:54 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.302s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:51:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:51:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:51:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:51:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:51:57 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:51:57 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [req-22d831bb-4c8e-4241-b9db-a1ca75c957c1 req-64b084f4-13af-42cb-92d0-83b215f4569a tempest-TestMinimumBasicScenario-1354421378 None] Terminate volume connection completed successfully. Jul 30 16:52:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [req-22d831bb-4c8e-4241-b9db-a1ca75c957c1 req-64b084f4-13af-42cb-92d0-83b215f4569a tempest-TestMinimumBasicScenario-1354421378 None] Deleting attachment 2f42fa63-aded-4913-aee7-40a278ea8167. {{(pid=88380) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 30 16:52:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Acquiring lock "cinder-88c4d606-855a-4c67-907a-29bf04695524-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Lock "cinder-88c4d606-855a-4c67-907a-29bf04695524-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Acquiring lock "cinder-quobyte-88c4d606-855a-4c67-907a-29bf04695524" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:52:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Lock "cinder-quobyte-88c4d606-855a-4c67-907a-29bf04695524" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:52:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf7642b-aff8-47ac-b652-68cabbe978fd]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:52:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:34 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 Jul 30 16:52:34 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:35 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524" returned: 0 in 0.361s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:35 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524 Jul 30 16:52:35 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:35 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-88c4d606-855a-4c67-907a-29bf04695524" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Lock "cinder-quobyte-88c4d606-855a-4c67-907a-29bf04695524" released by "delete_volume" :: held 0.648s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Created reservations ['139616c0-ff2c-43d1-af68-838d38cf7181', '4a1b2223-add2-4640-9255-2e671ba9c30c', '5e6d514d-5cc0-47c5-bf8c-bd07c9707a36', '8af4297a-deb6-4c93-b918-a31af60f93a4'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:35 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:52:35 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:35 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.279s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Deleted volume successfully. Jul 30 16:52:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d12edfab-ccb6-45a8-b80b-2eaa8487b04d tempest-TestMinimumBasicScenario-1354421378 None] Lock "cinder-88c4d606-855a-4c67-907a-29bf04695524-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:52:45 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:45 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:52:54 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:52:54 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:52:54 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.241s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:52:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Flow 'volume_create_manager' (5b2b9f39-20c6-40b8-b865-d8a5d538e312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3359f38e-0498-4f24-b122-a99af584d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3359f38e-0498-4f24-b122-a99af584d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-893466724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378edbf4-68de-48f4-a1fa-bd8eeeac8d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f946cd2598457b94e59071274fbaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:08Z,use_quota=True,user_id='01a096f241c447078095577f9d78d80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344aa66f-f085-40f7-94e6-4260718e09b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344aa66f-f085-40f7-94e6-4260718e09b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a4c99b-361f-44d7-b03f-036e1d35fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a4c99b-361f-44d7-b03f-036e1d35fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378edbf4-68de-48f4-a1fa-bd8eeeac8d65', 'volume_name': 'volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79255120-e6b9-4d79-bf98-8c3b1726972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79255120-e6b9-4d79-bf98-8c3b1726972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e32aacc-72a9-43a7-b8aa-5a660104bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Volume 378edbf4-68de-48f4-a1fa-bd8eeeac8d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65', 'volume_size': 1} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-893466724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378edbf4-68de-48f4-a1fa-bd8eeeac8d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f946cd2598457b94e59071274fbaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:08Z,use_quota=True,user_id='01a096f241c447078095577f9d78d80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Creating volume 378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:08 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:08 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 1073741824 Jul 30 16:53:08 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:08 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 1073741824" returned: 0 in 0.391s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:08 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 Jul 30 16:53:08 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:08 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" returned: 0 in 0.228s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e32aacc-72a9-43a7-b8aa-5a660104bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc42e55e-3d8d-4989-86f6-a7f312a000f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:09 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Volume volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 (378edbf4-68de-48f4-a1fa-bd8eeeac8d65): created successfully Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc42e55e-3d8d-4989-86f6-a7f312a000f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Flow 'volume_create_manager' (5b2b9f39-20c6-40b8-b865-d8a5d538e312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-80e3cf9e-0aaf-494a-92ed-208557765275 tempest-SnapshotDependencyTests-1401030652 None] Created volume successfully. Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Creating offline snapshot 1b87978c-23f2-4f1c-936a-159e9063bce2 of volume 378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8691def-52b7-4759-bd22-38ec8cbb9b81]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:09 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 Jul 30 16:53:09 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:09 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:09 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 1G Jul 30 16:53:09 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:10 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 1G" returned: 0 in 0.367s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:10 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 Jul 30 16:53:10 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:10 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2" returned: 0 in 0.274s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:10 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 is being set with open permissions: ugo+rw Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:10 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 Jul 30 16:53:10 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:10 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2" returned: 0 in 0.229s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:10 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info Jul 30 16:53:10 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:10 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info" returned: 0 in 0.234s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:10 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info is being set with open permissions: ugo+rw Jul 30 16:53:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:10 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info Jul 30 16:53:10 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:11 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.info" returned: 0 in 0.227s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.750s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dd4a3b06-b738-462e-bb41-95bdc65efd87 tempest-SnapshotDependencyTests-1401030652 None] Create snapshot completed successfully Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Flow 'volume_create_manager' (221a7fac-676b-4888-bfc6-a7b479d40660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7cc8d1-7a42-4bf9-a5a7-f928f496cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7cc8d1-7a42-4bf9-a5a7-f928f496cea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6b807a-ac62-4267-9cfb-246838cb68b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f946cd2598457b94e59071274fbaef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b87978c-23f2-4f1c-936a-159e9063bce2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:12Z,use_quota=True,user_id='01a096f241c447078095577f9d78d80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e506b4ce-871b-4032-8cb8-7e4beb87446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e506b4ce-871b-4032-8cb8-7e4beb87446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09203cc-d551-43a8-a5c3-214ab610e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09203cc-d551-43a8-a5c3-214ab610e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d6b807a-ac62-4267-9cfb-246838cb68b3', 'volume_name': 'volume-8d6b807a-ac62-4267-9cfb-246838cb68b3', 'volume_size': 1, 'snapshot_id': '1b87978c-23f2-4f1c-936a-159e9063bce2'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f784b926-1666-4de5-b212-436b51e65800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f784b926-1666-4de5-b212-436b51e65800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc54349-9514-4af3-8382-b6a2e39158c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:12 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Volume 8d6b807a-ac62-4267-9cfb-246838cb68b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d6b807a-ac62-4267-9cfb-246838cb68b3', 'volume_size': 1, 'snapshot_id': '1b87978c-23f2-4f1c-936a-159e9063bce2'} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-quobyte-1b87978c-23f2-4f1c-936a-159e9063bce2-8d6b807a-ac62-4267-9cfb-246838cb68b3" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-1b87978c-23f2-4f1c-936a-159e9063bce2-8d6b807a-ac62-4267-9cfb-246838cb68b3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Creating volume 8d6b807a-ac62-4267-9cfb-246838cb68b3 from snapshot 1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-quobyte-8d6b807a-ac62-4267-9cfb-246838cb68b3" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-8d6b807a-ac62-4267-9cfb-246838cb68b3" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] snapshot: 1b87978c-23f2-4f1c-936a-159e9063bce2, volume: 8d6b807a-ac62-4267-9cfb-246838cb68b3, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a2ab5-d1c5-4472-be4f-4681edbfe86e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:12 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 Jul 30 16:53:12 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:12 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2" returned: 0 in 0.348s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e405f816-d060-4b57-9e75-b3456cb99c34]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:12 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 Jul 30 16:53:12 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:12 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:53:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:13 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 Jul 30 16:53:13 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:16 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3" returned: 0 in 3.776s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:16 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65, size 1024.00 MB, duration 3.78 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:53:16 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Converted 1024.00 MB image at 271.10 MB/s Jul 30 16:53:16 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 is being set with open permissions: ugo+rw Jul 30 16:53:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:16 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 Jul 30 16:53:16 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:17 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3" returned: 0 in 0.235s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-8d6b807a-ac62-4267-9cfb-246838cb68b3" released by "_copy_volume_from_snapshot" :: held 4.770s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-1b87978c-23f2-4f1c-936a-159e9063bce2-8d6b807a-ac62-4267-9cfb-246838cb68b3" released by "_create_volume_from_snapshot" :: held 4.824s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.839s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc54349-9514-4af3-8382-b6a2e39158c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6b807a-ac62-4267-9cfb-246838cb68b3', 'volume_size': 1, 'snapshot_id': '1b87978c-23f2-4f1c-936a-159e9063bce2'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1020a3c-c497-4dbf-87c2-051fcda581ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:17 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Volume volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 (8d6b807a-ac62-4267-9cfb-246838cb68b3): created successfully Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1020a3c-c497-4dbf-87c2-051fcda581ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Flow 'volume_create_manager' (221a7fac-676b-4888-bfc6-a7b479d40660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:17 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e8b31216-a4bf-41a8-80bf-802b9486ef30 tempest-SnapshotDependencyTests-1401030652 None] Created volume successfully. Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-1b87978c-23f2-4f1c-936a-159e9063bce2-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-1b87978c-23f2-4f1c-936a-159e9063bce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-quobyte-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-quobyte-1b87978c-23f2-4f1c-936a-159e9063bce2" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-1b87978c-23f2-4f1c-936a-159e9063bce2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Deleting offline snapshot 1b87978c-23f2-4f1c-936a-159e9063bce2 of volume 378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] snapshot_file for this snap is: volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7991df-b0e2-4328-8a99-02e0452f960e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:17 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 Jul 30 16:53:17 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:18 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2" returned: 0 in 0.350s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e6613-adb8-4226-b761-418f49c25d83]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:18 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 Jul 30 16:53:18 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:18 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" returned: 0 in 0.506s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:18 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 Jul 30 16:53:18 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:18 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:18 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2 Jul 30 16:53:18 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:19 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65.1b87978c-23f2-4f1c-936a-159e9063bce2" returned: 0 in 0.266s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-1b87978c-23f2-4f1c-936a-159e9063bce2" released by "_delete_snapshot" :: held 1.545s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" released by "delete_snapshot" :: held 1.568s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Created reservations ['d3ee54c6-837c-44a7-bf91-d3a1ad1ae6cf', 'cfd4a7ac-6328-4cfe-8309-d569525a4934', '75421985-90f6-40bc-b05a-eeadb94ccaae', 'f384592b-4d92-4d45-9599-bcac051609df'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:19 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Delete snapshot completed successfully. Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-3d2b5a00-2d6a-4533-81c7-48991ba1da0d tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-1b87978c-23f2-4f1c-936a-159e9063bce2-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-378edbf4-68de-48f4-a1fa-bd8eeeac8d65-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-378edbf4-68de-48f4-a1fa-bd8eeeac8d65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-quobyte-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a698d7e8-c6fc-42d3-8473-41e43d2ae1d4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:19 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 Jul 30 16:53:19 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:20 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" returned: 0 in 0.346s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:20 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65 Jul 30 16:53:20 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:20 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" returned: 0 in 0.237s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-378edbf4-68de-48f4-a1fa-bd8eeeac8d65" released by "delete_volume" :: held 0.637s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Created reservations ['f200b482-6988-44ce-a824-597ed52177df', 'f81147e7-4590-424a-b4e5-de71444f6023', '2efeea29-918d-4e5f-aa5d-f338e83b9b55', 'a7f3072a-581c-401e-ba69-5c4f20056cf5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:20 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:20 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:20 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.248s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:20 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Deleted volume successfully. Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-431979ca-7728-4787-8a8a-3dc4780bfd6a tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-378edbf4-68de-48f4-a1fa-bd8eeeac8d65-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-8d6b807a-ac62-4267-9cfb-246838cb68b3-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-8d6b807a-ac62-4267-9cfb-246838cb68b3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "cinder-quobyte-8d6b807a-ac62-4267-9cfb-246838cb68b3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-8d6b807a-ac62-4267-9cfb-246838cb68b3" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2281c970-5bbc-4821-91f4-c887ce513335]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:21 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 Jul 30 16:53:21 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:21 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3" returned: 0 in 0.338s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:21 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3 Jul 30 16:53:21 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:21 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8d6b807a-ac62-4267-9cfb-246838cb68b3" returned: 0 in 0.235s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-quobyte-8d6b807a-ac62-4267-9cfb-246838cb68b3" released by "delete_volume" :: held 0.609s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Created reservations ['01708c27-a58f-4198-8bb4-488be1be22da', '20a50ac1-d369-477c-8a16-92007a4315a8', '23e740a8-0156-4722-8f03-0f6158457fb7', '543a3b37-7d57-4069-b43f-b447997561a3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:21 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:21 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:21 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.231s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Deleted volume successfully. Jul 30 16:53:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a2a5cb31-a3fc-4f59-8c1e-1db6e067cd42 tempest-SnapshotDependencyTests-1401030652 None] Lock "cinder-8d6b807a-ac62-4267-9cfb-246838cb68b3-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:31 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=33,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:53:31 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=8 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (9efb61d8-59fd-4112-a127-6da45c9f2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7909df01-ee77-40ba-8e07-4b813d2160f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7909df01-ee77-40ba-8e07-4b813d2160f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254879012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca9addc-a34c-4a5b-92b0-ac149c8c7148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:42Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45210437-a583-41b9-baf9-9f8374fb1ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45210437-a583-41b9-baf9-9f8374fb1ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4366cb8-b72d-477c-ae01-23948683b818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4366cb8-b72d-477c-ae01-23948683b818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca9addc-a34c-4a5b-92b0-ac149c8c7148', 'volume_name': 'volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859695aa-1732-4898-bf82-73161315b219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859695aa-1732-4898-bf82-73161315b219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5878fcb-b576-42c5-916e-d7c02724bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume fca9addc-a34c-4a5b-92b0-ac149c8c7148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148', 'volume_size': 1} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1254879012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca9addc-a34c-4a5b-92b0-ac149c8c7148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:42Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Creating volume fca9addc-a34c-4a5b-92b0-ac149c8c7148 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:42 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:42 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 1073741824 Jul 30 16:53:42 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (2eceebf0-353d-4bf7-b266-72fe77aeb4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f41180e-7dae-487a-9a0e-8562c7c54d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f41180e-7dae-487a-9a0e-8562c7c54d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953617458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36fe62d-e3ad-457b-b9b8-267eb28a048c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:42Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e07e592-e61c-41aa-a038-b1e61e872c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e07e592-e61c-41aa-a038-b1e61e872c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db44ba1e-d0aa-418c-b005-a71694e45981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db44ba1e-d0aa-418c-b005-a71694e45981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36fe62d-e3ad-457b-b9b8-267eb28a048c', 'volume_name': 'volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab14ab7-7bfb-4792-97b5-26b60c61611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab14ab7-7bfb-4792-97b5-26b60c61611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7739b1-317d-4c5c-92f5-1eb925095e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume f36fe62d-e3ad-457b-b9b8-267eb28a048c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c', 'volume_size': 1} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Flow 'volume_create_manager' (fdec2871-b0cd-45e0-8efc-7cd3a3ad8d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905163bf-b72f-4e3b-b01b-26b8364a9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905163bf-b72f-4e3b-b01b-26b8364a9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8692bbc6-c6c3-4dd6-919e-1c36d8d6209b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ba62dfc75412aab13d01ed0d9e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:43Z,use_quota=True,user_id='c5ec36807b9349afa7f62a005f00e61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a894c212-24fb-458c-ba8a-b4e3bb37c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a894c212-24fb-458c-ba8a-b4e3bb37c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7035d76-27d4-4926-9940-716a9874ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7035d76-27d4-4926-9940-716a9874ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8692bbc6-c6c3-4dd6-919e-1c36d8d6209b', 'volume_name': 'volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76234928-f8b7-4918-b3b6-123e8f389246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76234928-f8b7-4918-b3b6-123e8f389246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98624d30-bf2d-4737-928f-6706f41dc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:42 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Volume 8692bbc6-c6c3-4dd6-919e-1c36d8d6209b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b', 'volume_size': 1} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:42 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 1073741824" returned: 0 in 0.590s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:43 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 Jul 30 16:53:43 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:43 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953617458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36fe62d-e3ad-457b-b9b8-267eb28a048c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:42Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating volume f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:43 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5878fcb-b576-42c5-916e-d7c02724bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:43 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c 1073741824 Jul 30 16:53:43 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d327bd-e8b4-464c-977b-0024109f5ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 (fca9addc-a34c-4a5b-92b0-ac149c8c7148): created successfully Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d327bd-e8b4-464c-977b-0024109f5ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (9efb61d8-59fd-4112-a127-6da45c9f2127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dfb6c77f-d8bd-4124-8fcd-ccf55354115b tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created volume successfully. Jul 30 16:53:43 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c 1073741824" returned: 0 in 0.482s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:43 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c Jul 30 16:53:43 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:44 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8692bbc6-c6c3-4dd6-919e-1c36d8d6209b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ba62dfc75412aab13d01ed0d9e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:43Z,use_quota=True,user_id='c5ec36807b9349afa7f62a005f00e61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Creating volume 8692bbc6-c6c3-4dd6-919e-1c36d8d6209b {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:44 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7739b1-317d-4c5c-92f5-1eb925095e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:44 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b 1073741824 Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d518f8-9027-4d42-a998-2b338042d78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:44 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c (f36fe62d-e3ad-457b-b9b8-267eb28a048c): created successfully Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d518f8-9027-4d42-a998-2b338042d78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (2eceebf0-353d-4bf7-b266-72fe77aeb4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e24933aa-9fe8-47ae-8070-fd2e4f0cf6f8 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created volume successfully. Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (a1448cd5-970e-4a99-9828-2eb9e04c4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:44 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8386631-976c-4e7d-b2ba-9e9e55b384eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b 1073741824" returned: 0 in 0.584s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8386631-976c-4e7d-b2ba-9e9e55b384eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172252605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db72c90-ce07-47bd-81e8-7cb4ca0e385a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:45Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bad72e-763c-44cf-9555-4b30f2b7dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bad72e-763c-44cf-9555-4b30f2b7dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b0a29-bf8c-46e2-bd31-0282f3ae99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b0a29-bf8c-46e2-bd31-0282f3ae99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db72c90-ce07-47bd-81e8-7cb4ca0e385a', 'volume_name': 'volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b451a4-f943-4b6e-8bb2-b7f6ac336b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b451a4-f943-4b6e-8bb2-b7f6ac336b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796411cc-9961-4625-bcb5-7ba7e00740a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume 1db72c90-ce07-47bd-81e8-7cb4ca0e385a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a', 'volume_size': 1} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:44 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b Jul 30 16:53:44 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:45 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (d6e1ffe2-f205-4eda-89c1-e03f3b26233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e418079a-8dbd-46cd-b860-6a6ca4c9e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172252605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db72c90-ce07-47bd-81e8-7cb4ca0e385a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:45Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Creating volume 1db72c90-ce07-47bd-81e8-7cb4ca0e385a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:45 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:45 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a 1073741824 Jul 30 16:53:45 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e418079a-8dbd-46cd-b860-6a6ca4c9e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997192984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29b39ff-ebcb-4f27-a2df-d034cb502208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:45Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf14151-0c0e-432f-b018-70b0a5969a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf14151-0c0e-432f-b018-70b0a5969a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4250f9-de13-40a4-a819-49a97776884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4250f9-de13-40a4-a819-49a97776884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29b39ff-ebcb-4f27-a2df-d034cb502208', 'volume_name': 'volume-f29b39ff-ebcb-4f27-a2df-d034cb502208', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a378b92c-1155-46ba-8384-7e40f89b09bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a378b92c-1155-46ba-8384-7e40f89b09bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c1481b-02b5-4010-84e1-1b9c054f99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume f29b39ff-ebcb-4f27-a2df-d034cb502208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29b39ff-ebcb-4f27-a2df-d034cb502208', 'volume_size': 1} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98624d30-bf2d-4737-928f-6706f41dc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889227a4-76d4-4cdd-808b-15ee00a33dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Volume volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b (8692bbc6-c6c3-4dd6-919e-1c36d8d6209b): created successfully Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (889227a4-76d4-4cdd-808b-15ee00a33dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Flow 'volume_create_manager' (fdec2871-b0cd-45e0-8efc-7cd3a3ad8d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f1638ca0-22d4-4e1a-b1f8-d72c78493987 tempest-CinderUnicodeTest-1321868906 None] Created volume successfully. Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (d920525e-198b-4600-b51a-2e064242d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbd773d-3e7a-432d-9fa1-0e2ddefb8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbd773d-3e7a-432d-9fa1-0e2ddefb8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204310823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e5f0af-2d3f-45be-8227-52d05915db58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500da090-f9d9-4c11-b333-38c261fe2e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500da090-f9d9-4c11-b333-38c261fe2e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3260a51f-48f0-4a05-8392-d77995c0a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3260a51f-48f0-4a05-8392-d77995c0a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e5f0af-2d3f-45be-8227-52d05915db58', 'volume_name': 'volume-18e5f0af-2d3f-45be-8227-52d05915db58', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e825b7a-f56f-4018-acf9-e716a1821df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e825b7a-f56f-4018-acf9-e716a1821df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01be1de9-9a53-455c-87f0-42594d8449a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:45 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume 18e5f0af-2d3f-45be-8227-52d05915db58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e5f0af-2d3f-45be-8227-52d05915db58', 'volume_size': 1} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a 1073741824" returned: 0 in 0.673s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:45 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a Jul 30 16:53:45 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (e794a5ec-4727-482c-bea3-0a93f96f83df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e279ad5c-f738-4e94-92bb-41629d55b62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e279ad5c-f738-4e94-92bb-41629d55b62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261325519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4e6e2e-c94e-4c56-963b-53be2ac97266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5275781-26f4-4222-9ca4-24d007a04a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5275781-26f4-4222-9ca4-24d007a04a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3e5152-8bcf-4ab5-b49e-c738f2a1a18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3e5152-8bcf-4ab5-b49e-c738f2a1a18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4e6e2e-c94e-4c56-963b-53be2ac97266', 'volume_name': 'volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2518e21-8534-41ce-a3bf-315d78c54c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2518e21-8534-41ce-a3bf-315d78c54c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e600db2-f0ad-475e-a0ab-82ae3f035527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume ed4e6e2e-c94e-4c56-963b-53be2ac97266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266', 'volume_size': 1} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:46 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a" returned: 0 in 0.321s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997192984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29b39ff-ebcb-4f27-a2df-d034cb502208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:45Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Creating volume f29b39ff-ebcb-4f27-a2df-d034cb502208 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:46 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796411cc-9961-4625-bcb5-7ba7e00740a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363b0b53-175e-4f57-8c33-348ac958b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 1073741824 Jul 30 16:53:46 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a (1db72c90-ce07-47bd-81e8-7cb4ca0e385a): created successfully Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363b0b53-175e-4f57-8c33-348ac958b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (a1448cd5-970e-4a99-9828-2eb9e04c4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:46 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e45ccb90-5b16-42e7-a506-d18ce3d1c00c tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created volume successfully. Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (0c99c99e-7f68-416f-8daf-37add0ae1bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51406ba-540c-4789-9181-ad5e73eb644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51406ba-540c-4789-9181-ad5e73eb644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692836989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed09f2e-add9-487b-b6f4-112d59ef1cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80175a88-7daf-4248-9fa2-17cf52e04354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80175a88-7daf-4248-9fa2-17cf52e04354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3a004e-1f53-4138-9ec7-972d7857638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3a004e-1f53-4138-9ec7-972d7857638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed09f2e-add9-487b-b6f4-112d59ef1cba', 'volume_name': 'volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004160fc-0363-44c9-a86d-dcffdb6cc29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004160fc-0363-44c9-a86d-dcffdb6cc29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cff6bce-9419-4e26-9205-3d5f9ff6365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume 8ed09f2e-add9-487b-b6f4-112d59ef1cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba', 'volume_size': 1} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Flow 'volume_create_manager' (abe8a322-d715-4620-8493-5a3f30267ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:46 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ccf1f3-9392-45fd-b0f3-daeafaa13572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 1073741824" returned: 0 in 0.635s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ccf1f3-9392-45fd-b0f3-daeafaa13572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f074adc4-ee80-4595-b137-e5384d7fbdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119ee6cfa0f64866b814aded1a49400c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='7193a82fc60e417db4949041ffeba828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75f7ba17-f4fe-4fbb-b165-8ab51af1766f),volume_type_id=75f7ba17-f4fe-4fbb-b165-8ab51af1766f)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd9b8b8-4bd4-44c0-98ef-23e74c77adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd9b8b8-4bd4-44c0-98ef-23e74c77adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62b4c0b-10a2-4fb7-93cb-bbae70e20275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:53:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:46 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 Jul 30 16:53:46 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.472s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c1481b-02b5-4010-84e1-1b9c054f99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29b39ff-ebcb-4f27-a2df-d034cb502208', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65356c40-e72d-47a8-afef-ed3e6e3ffeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating offline snapshot 6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a of volume f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:53:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 (f29b39ff-ebcb-4f27-a2df-d034cb502208): created successfully Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65356c40-e72d-47a8-afef-ed3e6e3ffeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (d6e1ffe2-f205-4eda-89c1-e03f3b26233b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2dca09-eacb-41e7-ae71-8df133edad67]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Flow 'volume_create_manager' (94922b90-1166-4b9a-a243-af7c31201de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8e6416-856d-4942-a2bb-eb5d39e4046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ab054321-77c2-4fb6-b643-fde654916236 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created volume successfully. Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8e6416-856d-4942-a2bb-eb5d39e4046e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2121074255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ba62dfc75412aab13d01ed0d9e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='c5ec36807b9349afa7f62a005f00e61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb4722e-36f6-4140-9f61-ff26a689d430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c Jul 30 16:53:47 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb4722e-36f6-4140-9f61-ff26a689d430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e638a8-0519-4aaa-94f2-1a18d72642ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e638a8-0519-4aaa-94f2-1a18d72642ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3', 'volume_name': 'volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a9b19a-d608-4132-b7c7-04e5d15b16dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a9b19a-d608-4132-b7c7-04e5d15b16dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6df647-e435-4c3e-baf9-3d60642b5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Volume 841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3', 'volume_size': 1} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62b4c0b-10a2-4fb7-93cb-bbae70e20275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f074adc4-ee80-4595-b137-e5384d7fbdfd', 'volume_name': 'volume-f074adc4-ee80-4595-b137-e5384d7fbdfd', 'volume_size': 1, 'image_id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f781b2aa-d50b-496b-b48c-19830bd7d56c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '818832035a777cc5b434694cb875d237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '119ee6cfa0f64866b814aded1a49400c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99a2b9bbe0b220fcff4e8897cf94ea937732f56aa99d2321cd9083c85b93291b4341d4ab0dda4bc8961a95d313b554a761b4cb9183ec0090ad31ebb20a360fb7', 'id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'created_at': datetime.datetime(2026, 7, 30, 14, 53, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 53, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f781b2aa-d50b-496b-b48c-19830bd7d56c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dc763d-176f-43fb-85fb-671829f5daf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dc763d-176f-43fb-85fb-671829f5daf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760222a0-59b2-4ac1-a10b-133864ab7463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:47 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Volume f074adc4-ee80-4595-b137-e5384d7fbdfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f074adc4-ee80-4595-b137-e5384d7fbdfd', 'volume_size': 1, 'image_id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f781b2aa-d50b-496b-b48c-19830bd7d56c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '818832035a777cc5b434694cb875d237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '119ee6cfa0f64866b814aded1a49400c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99a2b9bbe0b220fcff4e8897cf94ea937732f56aa99d2321cd9083c85b93291b4341d4ab0dda4bc8961a95d313b554a761b4cb9183ec0090ad31ebb20a360fb7', 'id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'created_at': datetime.datetime(2026, 7, 30, 14, 53, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 53, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f781b2aa-d50b-496b-b48c-19830bd7d56c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Trying to clone f074adc4-ee80-4595-b137-e5384d7fbdfd from image f781b2aa-d50b-496b-b48c-19830bd7d56c at location (None, [{'url': 'file:///opt/stack/data/glance/images/f781b2aa-d50b-496b-b48c-19830bd7d56c', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:53:47 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c283365d-2055-493b-ae19-5ac73e7c875c]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c" returned: 0 in 0.389s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:47 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a 1G Jul 30 16:53:47 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:47 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD Jul 30 16:53:47 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a 1G" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a Jul 30 16:53:48 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD Jul 30 16:53:48 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Temporary image f781b2aa-d50b-496b-b48c-19830bd7d56c is fetched for user 7193a82fc60e417db4949041ffeba828. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:53:48 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" returned: 0 in 0.278s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a is being set with open permissions: ugo+rw Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a Jul 30 16:53:48 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ff5376-8102-4bd1-be87-1fc8e18559a5]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD Jul 30 16:53:48 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" returned: 0 in 0.242s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info Jul 30 16:53:48 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD Jul 30 16:53:48 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:48 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info" returned: 0 in 0.279s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:48 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info is being set with open permissions: ugo+rw Jul 30 16:53:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:48 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info Jul 30 16:53:48 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:49 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:49 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.info" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.413s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-204310823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e5f0af-2d3f-45be-8227-52d05915db58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Creating volume 18e5f0af-2d3f-45be-8227-52d05915db58 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:49 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:49 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 1073741824 Jul 30 16:53:49 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-60a6c6cd-d590-432a-bb8f-f992a94a2e64 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Create snapshot completed successfully Jul 30 16:53:49 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 1073741824" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:49 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 Jul 30 16:53:49 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:49 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.880s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261325519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4e6e2e-c94e-4c56-963b-53be2ac97266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Creating volume ed4e6e2e-c94e-4c56-963b-53be2ac97266 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:49 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01be1de9-9a53-455c-87f0-42594d8449a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e5f0af-2d3f-45be-8227-52d05915db58', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 1073741824 Jul 30 16:53:50 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e31389-be86-4278-ad18-65f717b66f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume volume-18e5f0af-2d3f-45be-8227-52d05915db58 (18e5f0af-2d3f-45be-8227-52d05915db58): created successfully Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e31389-be86-4278-ad18-65f717b66f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (d920525e-198b-4600-b51a-2e064242d898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9b58d51a-6764-4be8-80bb-f23eaa41431e tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created volume successfully. Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (786b48dc-ee47-4ba2-b009-e8e5ee37dcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba714ab2-53f2-4107-9400-22a453e95880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba714ab2-53f2-4107-9400-22a453e95880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94090891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1e0443-b420-4192-bfa2-b31f50dbe492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:50Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920ca87-fae7-47d8-bc7a-9b1cd829a6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920ca87-fae7-47d8-bc7a-9b1cd829a6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ad51f5-6a9d-46e2-b171-82a1150787a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ad51f5-6a9d-46e2-b171-82a1150787a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c1e0443-b420-4192-bfa2-b31f50dbe492', 'volume_name': 'volume-6c1e0443-b420-4192-bfa2-b31f50dbe492', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1856505-b17d-4214-8151-86be3fd41d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1856505-b17d-4214-8151-86be3fd41d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173330c8-25eb-493e-a2a6-cbceccde5f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume 6c1e0443-b420-4192-bfa2-b31f50dbe492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c1e0443-b420-4192-bfa2-b31f50dbe492', 'volume_size': 1} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:50 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 1073741824" returned: 0 in 0.550s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (aa15db5e-d7b8-4647-ab60-5b2d98d6cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67466fc2-c8ed-47ec-9a97-79bea46a5208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67466fc2-c8ed-47ec-9a97-79bea46a5208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1767905561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d948839-8dd5-4143-a9f4-3ed10b6a9088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:51Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 Jul 30 16:53:50 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7cd8f2-4538-4991-bac4-422c45eeb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7cd8f2-4538-4991-bac4-422c45eeb96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bb37fd-2407-4131-a470-6670f2e3ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bb37fd-2407-4131-a470-6670f2e3ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d948839-8dd5-4143-a9f4-3ed10b6a9088', 'volume_name': 'volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca1ea21-eb22-49d9-8332-d6950a60314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca1ea21-eb22-49d9-8332-d6950a60314b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afde7df-8b46-4df8-8684-07738741ba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:50 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume 2d948839-8dd5-4143-a9f4-3ed10b6a9088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088', 'volume_size': 1} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:50 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.304s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692836989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed09f2e-add9-487b-b6f4-112d59ef1cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb9c3909e974ef79f39434ed2ad990c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:46Z,use_quota=True,user_id='8853f5b562ae4494b76fc96f6f6abedd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Creating volume 8ed09f2e-add9-487b-b6f4-112d59ef1cba {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:50 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e600db2-f0ad-475e-a0ab-82ae3f035527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e8eafb-b5d0-4895-a83f-80f470e991e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba 1073741824 Jul 30 16:53:51 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 (ed4e6e2e-c94e-4c56-963b-53be2ac97266): created successfully Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e8eafb-b5d0-4895-a83f-80f470e991e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (e794a5ec-4727-482c-bea3-0a93f96f83df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-386f7bf8-ee27-4911-906d-2c99e2dbd2cf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created volume successfully. Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (b872b438-0bab-4ef5-81ad-2aadca39920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958feb4b-a02c-4927-9710-051d3eca0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958feb4b-a02c-4927-9710-051d3eca0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963291984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3017bf24-e628-49ee-8c4b-ae48a4b722a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:51Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd538fd-18b2-4191-9390-b09f2eda2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd538fd-18b2-4191-9390-b09f2eda2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259f3632-d6ac-4e84-9e11-e80429b9311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259f3632-d6ac-4e84-9e11-e80429b9311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3017bf24-e628-49ee-8c4b-ae48a4b722a7', 'volume_name': 'volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8953c2be-a721-4714-a8fc-caf99bbf73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8953c2be-a721-4714-a8fc-caf99bbf73f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7314a85-70a5-44cb-9723-a3cdbbd6c3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume 3017bf24-e628-49ee-8c4b-ae48a4b722a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7', 'volume_size': 1} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (62978ddd-9255-4d62-828d-3a3ac67dc20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1411451-333e-437f-967f-30c02569b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1411451-333e-437f-967f-30c02569b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-350348986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:51Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f1efe3-1e96-4bf4-9e14-4903eece60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f1efe3-1e96-4bf4-9e14-4903eece60fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306bb97c-0be6-4c75-a818-bfa51cd22671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306bb97c-0be6-4c75-a818-bfa51cd22671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b', 'volume_name': 'volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471068a9-7d91-4a9c-91f5-f6e54c551a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (471068a9-7d91-4a9c-91f5-f6e54c551a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ddbba4-29b6-40fe-b71d-87625dac0114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b', 'volume_size': 1} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba 1073741824" returned: 0 in 0.544s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:51 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba Jul 30 16:53:51 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:53:51 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (93ddcbb8-8fd0-4394-a053-d2fccd3aa056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d876d84-28da-45b8-9eac-e56fe4e3e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba" returned: 0 in 0.306s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.409s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2121074255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea5ba62dfc75412aab13d01ed0d9e1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='c5ec36807b9349afa7f62a005f00e61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Creating volume 841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d876d84-28da-45b8-9eac-e56fe4e3e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260359827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aed7f0d-a25a-4567-b680-8e8deb711fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:52Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 1073741824 Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d92a80-0f90-487d-b120-641f754affaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d92a80-0f90-487d-b120-641f754affaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3e6918-3d57-4184-8020-bb6a5d2a66fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3e6918-3d57-4184-8020-bb6a5d2a66fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aed7f0d-a25a-4567-b680-8e8deb711fed', 'volume_name': 'volume-4aed7f0d-a25a-4567-b680-8e8deb711fed', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03a5018-be8c-4b1b-b43f-7982c53dd8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03a5018-be8c-4b1b-b43f-7982c53dd8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c8efd9-aeae-465a-95e8-b0e157799bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume 4aed7f0d-a25a-4567-b680-8e8deb711fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aed7f0d-a25a-4567-b680-8e8deb711fed', 'volume_size': 1} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cff6bce-9419-4e26-9205-3d5f9ff6365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b45135-f4e7-4bda-b927-aa9cca41a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Volume volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba (8ed09f2e-add9-487b-b6f4-112d59ef1cba): created successfully Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b45135-f4e7-4bda-b927-aa9cca41a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Flow 'volume_create_manager' (0c99c99e-7f68-416f-8daf-37add0ae1bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-eb379467-d587-4b5c-a109-c500d9f4bf01 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created volume successfully. Jul 30 16:53:52 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 1073741824" returned: 0 in 0.415s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:52 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 Jul 30 16:53:52 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:52 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" returned: 0 in 0.246s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f074adc4-ee80-4595-b137-e5384d7fbdfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='119ee6cfa0f64866b814aded1a49400c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:47Z,use_quota=True,user_id='7193a82fc60e417db4949041ffeba828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75f7ba17-f4fe-4fbb-b165-8ab51af1766f),volume_type_id=75f7ba17-f4fe-4fbb-b165-8ab51af1766f)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Creating volume f074adc4-ee80-4595-b137-e5384d7fbdfd {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:52 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:52 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd 1073741824 Jul 30 16:53:52 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6df647-e435-4c3e-baf9-3d60642b5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6dd9be-2e05-440c-befb-b2a4e91ad0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:52 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Volume volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 (841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3): created successfully Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6dd9be-2e05-440c-befb-b2a4e91ad0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Flow 'volume_create_manager' (94922b90-1166-4b9a-a243-af7c31201de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-49bf4369-bb7a-402b-8657-0d6201b17847 tempest-CinderUnicodeTest-1321868906 None] Created volume successfully. Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-8ed09f2e-add9-487b-b6f4-112d59ef1cba-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-8ed09f2e-add9-487b-b6f4-112d59ef1cba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:53 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd 1073741824" returned: 0 in 0.484s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-quobyte-8ed09f2e-add9-487b-b6f4-112d59ef1cba" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-8ed09f2e-add9-487b-b6f4-112d59ef1cba" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:53 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd Jul 30 16:53:53 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3707b1-d217-4c2c-a881-ef84af369276]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba Jul 30 16:53:53 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd" returned: 0 in 0.239s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.983s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94090891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1e0443-b420-4192-bfa2-b31f50dbe492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:50Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating volume 6c1e0443-b420-4192-bfa2-b31f50dbe492 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:53 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 1073741824 Jul 30 16:53:53 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Attempting download of f781b2aa-d50b-496b-b48c-19830bd7d56c ((None, [{'url': 'file:///opt/stack/data/glance/images/f781b2aa-d50b-496b-b48c-19830bd7d56c', 'metadata': {}}])) to volume f074adc4-ee80-4595-b137-e5384d7fbdfd. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c648a52c-f58f-4ec7-a0e4-2be410d7d203]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba" returned: 0 in 0.395s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8 Jul 30 16:53:53 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba Jul 30 16:53:53 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:53 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8" returned: 0 in 0.411s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8ed09f2e-add9-487b-b6f4-112d59ef1cba" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-8ed09f2e-add9-487b-b6f4-112d59ef1cba" released by "delete_volume" :: held 0.796s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:53 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 1073741824" returned: 0 in 0.579s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:53 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8 Jul 30 16:53:54 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created reservations ['106f818f-5534-453c-8c49-d4d0820b050a', '2d63507f-9ab5-432e-9634-d881e5700c4f', '830abeea-9040-475a-8eaa-ad9ec721e138', 'ba15e7a4-74dc-49c3-a887-3ec727003a82'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:54 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 Jul 30 16:53:54 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:54 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-ed4e6e2e-c94e-4c56-963b-53be2ac97266-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:54 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.524s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:54 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1767905561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d948839-8dd5-4143-a9f4-3ed10b6a9088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:51Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating volume 2d948839-8dd5-4143-a9f4-3ed10b6a9088 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:54 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-ed4e6e2e-c94e-4c56-963b-53be2ac97266-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8" returned: 1 in 0.425s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f781b2aa-d50b-496b-b48c-19830bd7d56c_8713rbz8' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:53:54 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 1073741824 Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173330c8-25eb-493e-a2a6-cbceccde5f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1e0443-b420-4192-bfa2-b31f50dbe492', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:54 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eb0159-ac73-4390-abad-6f2116aede9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09e962-b950-49b1-b3da-5341619428d1]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 (6c1e0443-b420-4192-bfa2-b31f50dbe492): created successfully Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1eb0159-ac73-4390-abad-6f2116aede9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (786b48dc-ee47-4ba2-b009-e8e5ee37dcf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-13d664dc-e28a-4f99-afdc-82e1eef07aad tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created volume successfully. Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-quobyte-ed4e6e2e-c94e-4c56-963b-53be2ac97266" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:54 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.313s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Deleted volume successfully. Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-ed4e6e2e-c94e-4c56-963b-53be2ac97266" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3e7e74-643f-4a81-b6c2-22dc523b5c71]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD Jul 30 16:53:54 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2dcb6a60-87c7-4172-9293-cd5fd088dde3 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-8ed09f2e-add9-487b-b6f4-112d59ef1cba-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:54 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 Jul 30 16:53:54 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:54 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 1073741824" returned: 0 in 0.507s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD Jul 30 16:53:54 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 Jul 30 16:53:54 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266" returned: 0 in 0.471s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:54 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266 Jul 30 16:53:54 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:54 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:53:55 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] f781b2aa-d50b-496b-b48c-19830bd7d56c was raw, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:55 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd Jul 30 16:53:55 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:55 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088" returned: 0 in 0.326s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.989s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963291984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3017bf24-e628-49ee-8c4b-ae48a4b722a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:51Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating volume 3017bf24-e628-49ee-8c4b-ae48a4b722a7 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:55 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afde7df-8b46-4df8-8684-07738741ba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea374dc-b485-4dc3-9eee-f2c1756ebb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:55 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 1073741824 Jul 30 16:53:55 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:55 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 (2d948839-8dd5-4143-a9f4-3ed10b6a9088): created successfully Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea374dc-b485-4dc3-9eee-f2c1756ebb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (aa15db5e-d7b8-4647-ab60-5b2d98d6cca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ed4e6e2e-c94e-4c56-963b-53be2ac97266" returned: 0 in 0.348s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-37eba618-a144-4c41-826a-fb219ab3de08 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created volume successfully. Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-ed4e6e2e-c94e-4c56-963b-53be2ac97266" released by "delete_volume" :: held 0.870s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created reservations ['aa8a43a6-0220-401c-a336-1a98ed163af5', '3da456eb-3277-4806-8850-264f2fb73a8d', '3be0c09b-299f-4786-b172-5e9d127a3df9', '38bd8e10-8a90-467e-bee9-488891ca0056'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:55 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:55 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:55 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd" returned: 0 in 0.511s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f781b2aa-d50b-496b-b48c-19830bd7d56c_77hz32erdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:53:55 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:55 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd 1G Jul 30 16:53:55 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:55 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 1073741824" returned: 0 in 0.485s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:55 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Deleted volume successfully. Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-774ef25c-1521-4a6a-96ec-23d191ac8b90 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-ed4e6e2e-c94e-4c56-963b-53be2ac97266-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:55 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 Jul 30 16:53:55 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:55 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd 1G" returned: 0 in 0.322s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Downloaded image f781b2aa-d50b-496b-b48c-19830bd7d56c ((None, [{'url': 'file:///opt/stack/data/glance/images/f781b2aa-d50b-496b-b48c-19830bd7d56c', 'metadata': {}}])) to volume f074adc4-ee80-4595-b137-e5384d7fbdfd successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Temporary image f781b2aa-d50b-496b-b48c-19830bd7d56c for user 7193a82fc60e417db4949041ffeba828 is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Marking volume f074adc4-ee80-4595-b137-e5384d7fbdfd as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Copying metadata from image f781b2aa-d50b-496b-b48c-19830bd7d56c to f074adc4-ee80-4595-b137-e5384d7fbdfd. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Creating volume glance metadata for volume f074adc4-ee80-4595-b137-e5384d7fbdfd backed by image f781b2aa-d50b-496b-b48c-19830bd7d56c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '818832035a777cc5b434694cb875d237', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:53:55 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7" returned: 0 in 0.252s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.489s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-350348986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:51Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating volume c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7314a85-70a5-44cb-9723-a3cdbbd6c3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:56 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b 1073741824 Jul 30 16:53:56 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892b5813-50d9-44c0-96da-afbef050a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 (3017bf24-e628-49ee-8c4b-ae48a4b722a7): created successfully Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892b5813-50d9-44c0-96da-afbef050a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (b872b438-0bab-4ef5-81ad-2aadca39920c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-33fb1e59-4a0f-4b28-9aac-807a97f4bc62 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created volume successfully. Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760222a0-59b2-4ac1-a10b-133864ab7463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f074adc4-ee80-4595-b137-e5384d7fbdfd', 'volume_size': 1, 'image_id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f781b2aa-d50b-496b-b48c-19830bd7d56c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '818832035a777cc5b434694cb875d237', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '119ee6cfa0f64866b814aded1a49400c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99a2b9bbe0b220fcff4e8897cf94ea937732f56aa99d2321cd9083c85b93291b4341d4ab0dda4bc8961a95d313b554a761b4cb9183ec0090ad31ebb20a360fb7', 'id': 'f781b2aa-d50b-496b-b48c-19830bd7d56c', 'created_at': datetime.datetime(2026, 7, 30, 14, 53, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 53, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f781b2aa-d50b-496b-b48c-19830bd7d56c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e501d1-d7ac-4884-96cc-12f934a54a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Volume volume-f074adc4-ee80-4595-b137-e5384d7fbdfd (f074adc4-ee80-4595-b137-e5384d7fbdfd): created successfully Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e501d1-d7ac-4884-96cc-12f934a54a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Flow 'volume_create_manager' (abe8a322-d715-4620-8493-5a3f30267ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0c69794e-7366-4825-9143-8ef02beb3701 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Created volume successfully. Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Acquiring lock "cinder-f074adc4-ee80-4595-b137-e5384d7fbdfd-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "cinder-f074adc4-ee80-4595-b137-e5384d7fbdfd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Acquiring lock "cinder-quobyte-f074adc4-ee80-4595-b137-e5384d7fbdfd" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "cinder-quobyte-f074adc4-ee80-4595-b137-e5384d7fbdfd" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0685970b-fb02-4262-b2de-a621db637bb6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:56 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b 1073741824" returned: 0 in 0.483s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-18e5f0af-2d3f-45be-8227-52d05915db58-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-18e5f0af-2d3f-45be-8227-52d05915db58-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:56 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd Jul 30 16:53:56 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:56 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b Jul 30 16:53:56 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-quobyte-18e5f0af-2d3f-45be-8227-52d05915db58" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-18e5f0af-2d3f-45be-8227-52d05915db58" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5598ae-29dd-445e-ac66-f0848df8527a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:56 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 Jul 30 16:53:56 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:56 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:56 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.898s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260359827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aed7f0d-a25a-4567-b680-8e8deb711fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0680c88971e4f128480850735eb9fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:53:52Z,use_quota=True,user_id='8b483e69f0b34b0cac5b7ee6d64d4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Creating volume 4aed7f0d-a25a-4567-b680-8e8deb711fed {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ddbba4-29b6-40fe-b71d-87625dac0114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:56 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed 1073741824 Jul 30 16:53:56 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ae17b4-e6b1-4f26-af5c-c28b425e5c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd" returned: 0 in 0.424s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b (c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b): created successfully Jul 30 16:53:56 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd Jul 30 16:53:56 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ae17b4-e6b1-4f26-af5c-c28b425e5c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:56 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (62978ddd-9255-4d62-828d-3a3ac67dc20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2c4a3b5f-d549-4140-99be-af0a62d7dec1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created volume successfully. Jul 30 16:53:57 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58" returned: 0 in 0.386s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:57 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58 Jul 30 16:53:57 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:57 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f074adc4-ee80-4595-b137-e5384d7fbdfd" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "cinder-quobyte-f074adc4-ee80-4595-b137-e5384d7fbdfd" released by "delete_volume" :: held 0.756s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Created reservations ['362d2c10-c650-438a-8435-799748ea547f', 'fcbe58bb-b2d0-4487-b2cb-b8802a3b35c3', '6b558a79-2826-41ca-aa68-a64728780afa', '4f9f9029-9cbc-482a-aec7-1bfe3efe4345'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:57 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:57 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-18e5f0af-2d3f-45be-8227-52d05915db58" returned: 0 in 0.302s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed 1073741824" returned: 0 in 0.498s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:57 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-18e5f0af-2d3f-45be-8227-52d05915db58" released by "delete_volume" :: held 0.746s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:57 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed Jul 30 16:53:57 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created reservations ['2ab777ef-6a1b-440e-ad92-6700b2417ec7', 'c681d5e8-c2df-475c-976f-a8ec16fc9e97', 'd061298f-f9f6-4ec3-9576-52ea959d5719', '4a9ace1c-47be-4c18-b88c-73c425d25523'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:57 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:57 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:57 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.317s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Deleted volume successfully. Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-00ad4317-50cb-459c-8306-7de78a056f33 tempest-VolumeAndVolumeTypeFromImageTest-334730170 None] Lock "cinder-f074adc4-ee80-4595-b137-e5384d7fbdfd-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-f29b39ff-ebcb-4f27-a2df-d034cb502208-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-f29b39ff-ebcb-4f27-a2df-d034cb502208-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:57 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed" returned: 0 in 0.382s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.859s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-quobyte-f29b39ff-ebcb-4f27-a2df-d034cb502208" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c8efd9-aeae-465a-95e8-b0e157799bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aed7f0d-a25a-4567-b680-8e8deb711fed', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68198639-cebf-4406-812d-4e99d97b5f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Creating offline snapshot 9c535d47-1d10-4936-bedd-2f377a848065 of volume 841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-f29b39ff-ebcb-4f27-a2df-d034cb502208" acquired by "delete_volume" :: waited 0.054s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[665249b7-1df3-4133-aef2-170f6350ed7f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:57 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Volume volume-4aed7f0d-a25a-4567-b680-8e8deb711fed (4aed7f0d-a25a-4567-b680-8e8deb711fed): created successfully Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68198639-cebf-4406-812d-4e99d97b5f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Flow 'volume_create_manager' (93ddcbb8-8fd0-4394-a053-d2fccd3aa056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:53:57 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0effcf65-2f70-4b67-b292-7473b76739ae]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.406s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:57 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Deleted volume successfully. Jul 30 16:53:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c9663a5b-a74f-4013-bdd9-f2ee8a0d431b tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created volume successfully. Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-11808128-3879-4256-a275-208ef605a083 tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-18e5f0af-2d3f-45be-8227-52d05915db58-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:58 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 Jul 30 16:53:58 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:58 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 Jul 30 16:53:58 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:58 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" returned: 0 in 0.453s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:58 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 1G Jul 30 16:53:58 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:58 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208" returned: 0 in 0.455s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:58 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208 Jul 30 16:53:58 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-4aed7f0d-a25a-4567-b680-8e8deb711fed-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-4aed7f0d-a25a-4567-b680-8e8deb711fed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-4aed7f0d-a25a-4567-b680-8e8deb711fed" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-4aed7f0d-a25a-4567-b680-8e8deb711fed" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[747ea64a-7cfc-49d7-920c-5be85f23d03f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:58 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f29b39ff-ebcb-4f27-a2df-d034cb502208" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-f29b39ff-ebcb-4f27-a2df-d034cb502208" released by "delete_volume" :: held 0.852s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created reservations ['bcf359b9-bc6a-4a1a-b1ae-deed000d57de', '7c0b7914-bb10-4084-8548-04d7e82d32df', '7b4c122f-2cda-435d-b17a-d1ea96094589', '000e8d01-882d-49f8-895c-f1b67a15677f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:58 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed Jul 30 16:53:58 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:58 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:58 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:58 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 1G" returned: 0 in 0.570s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-1db72c90-ce07-47bd-81e8-7cb4ca0e385a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:58 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 Jul 30 16:53:58 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-1db72c90-ce07-47bd-81e8-7cb4ca0e385a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-quobyte-1db72c90-ce07-47bd-81e8-7cb4ca0e385a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-1db72c90-ce07-47bd-81e8-7cb4ca0e385a" acquired by "delete_volume" :: waited 0.048s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88948f-ac51-4232-9477-880c1ed5fc40]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:59 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.385s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:59 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:53:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Deleted volume successfully. Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed" returned: 0 in 0.599s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:59 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed Jul 30 16:53:59 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-7a0dfa00-4f2d-4bc1-b5dd-da7b4b6f16cb tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-f29b39ff-ebcb-4f27-a2df-d034cb502208-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:59 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a Jul 30 16:53:59 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:59 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065" returned: 0 in 0.549s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:59 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 is being set with open permissions: ugo+rw Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:59 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 Jul 30 16:53:59 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:59 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aed7f0d-a25a-4567-b680-8e8deb711fed" returned: 0 in 0.306s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-4aed7f0d-a25a-4567-b680-8e8deb711fed" released by "delete_volume" :: held 0.947s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:53:59 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['2057b471-4149-4a29-8bb0-13aafe15f7d9', '8fa9fcd2-c84b-4430-bfc7-3781e0ad7af9', 'c99ba00f-31ec-4d6c-bab2-4408410ca553', '529e498f-48dd-44c3-b7e0-8c2de0071c91'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a" returned: 0 in 0.519s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:59 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a Jul 30 16:53:59 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:59 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065" returned: 0 in 0.321s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:53:59 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:53:59 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:53:59 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info Jul 30 16:53:59 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:00 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-1db72c90-ce07-47bd-81e8-7cb4ca0e385a" returned: 0 in 0.338s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-1db72c90-ce07-47bd-81e8-7cb4ca0e385a" released by "delete_volume" :: held 0.940s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created reservations ['fcb0b35e-c807-44f8-a81d-f1fc823a4ec5', '2ac5baac-bce6-4ce4-a6d1-7d60aa45ded6', '6e55dd73-3f3b-47d4-a4e5-3bddb51d6f4e', '5c06577a-643e-4640-b4b7-64cb2803b112'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:00 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info" returned: 0 in 0.306s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:00 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info is being set with open permissions: ugo+rw Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:00 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.355s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:00 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info Jul 30 16:54:00 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleted volume successfully. Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ff801cf4-32ae-48e4-a17d-dcc6778b1c46 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-4aed7f0d-a25a-4567-b680-8e8deb711fed-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:00 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:00 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:00 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.info" returned: 0 in 0.287s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:00 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ff8092ee-79e2-466a-a625-91d4522c42f9 tempest-CinderUnicodeTest-1321868906 None] Create snapshot completed successfully Jul 30 16:54:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Deleted volume successfully. Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-87148d71-79eb-498f-a3bb-bedd6f8c3a4f tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-1db72c90-ce07-47bd-81e8-7cb4ca0e385a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b" acquired by "delete_volume" :: waited 0.014s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7281b010-61f4-4252-b21c-436783675c02]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:01 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b Jul 30 16:54:01 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-9c535d47-1d10-4936-bedd-2f377a848065-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-9c535d47-1d10-4936-bedd-2f377a848065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-quobyte-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:01 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b" returned: 0 in 0.401s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-fca9addc-a34c-4a5b-92b0-ac149c8c7148-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:01 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b Jul 30 16:54:01 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-quobyte-9c535d47-1d10-4936-bedd-2f377a848065" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-fca9addc-a34c-4a5b-92b0-ac149c8c7148-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-9c535d47-1d10-4936-bedd-2f377a848065" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Deleting offline snapshot 9c535d47-1d10-4936-bedd-2f377a848065 of volume 841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] snapshot_file for this snap is: volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40c46da-dd9a-46db-b4d5-ef4024c91afd]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "cinder-quobyte-fca9addc-a34c-4a5b-92b0-ac149c8c7148" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-fca9addc-a34c-4a5b-92b0-ac149c8c7148" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[930699d8-6c83-4aca-b5eb-229deeabc2ef]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:01 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 Jul 30 16:54:01 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 Jul 30 16:54:01 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b" returned: 0 in 0.336s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b" released by "delete_volume" :: held 0.778s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['9b601154-ec51-42fc-b783-83855f8dca45', '42696493-144d-475a-9c65-1ffbd1cdff97', '088e3a6e-2e04-49ae-a8a9-a274738d7e29', '0b07f867-e01d-4fe0-bc96-2ca99b16362c'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:01 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:01 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:01 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065" returned: 0 in 0.459s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e397e07-178b-4be9-90c1-fa2fc72dff10]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148" returned: 0 in 0.457s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148 Jul 30 16:54:02 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-3017bf24-e628-49ee-8c4b-ae48a4b722a7-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-3017bf24-e628-49ee-8c4b-ae48a4b722a7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:02 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 Jul 30 16:54:02 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-3017bf24-e628-49ee-8c4b-ae48a4b722a7" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-3017bf24-e628-49ee-8c4b-ae48a4b722a7" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9abc3a-78a1-44e4-ad12-06d66b40b742]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.398s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleted volume successfully. Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a08521b3-97f6-4d02-97c6-87ee69715fed tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-c4e13651-1b7d-4d2c-acb7-34f1a6e23c5b-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:02 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 Jul 30 16:54:02 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fca9addc-a34c-4a5b-92b0-ac149c8c7148" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-quobyte-fca9addc-a34c-4a5b-92b0-ac149c8c7148" released by "delete_volume" :: held 0.910s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:02 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" returned: 0 in 0.468s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 Jul 30 16:54:02 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Created reservations ['ab01f4ca-20bc-4b2b-8b98-50664b537baa', 'b0dc080d-5dda-4086-9e61-b8bc6ca9fba8', 'bddaa99e-b710-45cb-8827-85c6e7a3a639', 'd177e551-a59c-4cab-abad-56fa616eb5f9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:02 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7" returned: 0 in 0.469s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7 Jul 30 16:54:02 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065" returned: 0 in 0.500s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:02 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:02 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:02 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065 Jul 30 16:54:02 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Deleted volume successfully. Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6da51cfe-419b-423a-b996-b60e8b18cbcf tempest-CreateVolumesFromSourceVolumeTest-1042142641 None] Lock "cinder-fca9addc-a34c-4a5b-92b0-ac149c8c7148-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:03 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (7621b395-279e-4f63-a0a9-7e325021d88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5caaaa-0ff7-4b00-988d-acfe7918106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-3017bf24-e628-49ee-8c4b-ae48a4b722a7" returned: 0 in 0.400s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-3017bf24-e628-49ee-8c4b-ae48a4b722a7" released by "delete_volume" :: held 0.922s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5caaaa-0ff7-4b00-988d-acfe7918106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-956253934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549af897-4215-409e-9b05-84cc243cae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:03Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c1815e-a578-421f-b587-11599265a879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c1815e-a578-421f-b587-11599265a879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b5aa96-a0b3-448a-8103-867a6f143336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b5aa96-a0b3-448a-8103-867a6f143336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549af897-4215-409e-9b05-84cc243cae12', 'volume_name': 'volume-549af897-4215-409e-9b05-84cc243cae12', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65d295f-b22f-42fb-97e7-d5e5de274518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65d295f-b22f-42fb-97e7-d5e5de274518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10caf402-b304-45ef-ad74-c5e7ae1e51ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Volume 549af897-4215-409e-9b05-84cc243cae12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549af897-4215-409e-9b05-84cc243cae12', 'volume_size': 1} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-956253934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549af897-4215-409e-9b05-84cc243cae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:03Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Creating volume 549af897-4215-409e-9b05-84cc243cae12 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:03 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:03 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 1073741824 Jul 30 16:54:03 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['0461f339-3ed4-43bc-b4a8-e1ce50c13f9e', '091c1825-eb24-4192-bb7f-e043a169256c', '47a4cd06-31ff-4abf-8dc5-8bb4f24bf5c3', 'bd2675d7-9bca-449d-9a2d-6c5d512813c9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:03 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3.9c535d47-1d10-4936-bedd-2f377a848065" returned: 0 in 0.401s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-9c535d47-1d10-4936-bedd-2f377a848065" released by "_delete_snapshot" :: held 1.988s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" released by "delete_snapshot" :: held 2.079s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:03 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:03 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (eef47abc-de26-424d-9558-0246aa5c1e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22df980-4731-4739-8780-683c1beae8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22df980-4731-4739-8780-683c1beae8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089879943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5010abb-696a-46c6-bb02-e803a7283c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:03Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a99a95-589f-4993-9333-b924906a7ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a99a95-589f-4993-9333-b924906a7ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ef9d5b-567f-409f-9ae1-0e8084a866ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ef9d5b-567f-409f-9ae1-0e8084a866ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5010abb-696a-46c6-bb02-e803a7283c44', 'volume_name': 'volume-b5010abb-696a-46c6-bb02-e803a7283c44', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712d4112-aa50-4b84-b2de-bcfdfdc0e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712d4112-aa50-4b84-b2de-bcfdfdc0e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca34728-916f-430b-b9e6-f5a4447f16f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:03 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Volume b5010abb-696a-46c6-bb02-e803a7283c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5010abb-696a-46c6-bb02-e803a7283c44', 'volume_size': 1} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Created reservations ['e26ad9e3-1376-4727-9bb9-7168c7b7539a', 'b7689951-00e6-44de-a113-e1a0b2d309a7', 'fefd8fe1-7d79-4f1f-91d6-6969212db721', '617b836a-2399-4610-89dd-7dd5c9610b64'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:03 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleted volume successfully. Jul 30 16:54:03 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 1073741824" returned: 0 in 0.631s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-83766995-8c72-4225-994c-48d1759de0c9 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-3017bf24-e628-49ee-8c4b-ae48a4b722a7-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Delete snapshot completed successfully. Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f11b26db-94b2-4bb5-bd4a-a6eb3f464426 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-9c535d47-1d10-4936-bedd-2f377a848065-delete_snapshot" released by "delete_snapshot" :: held 2.544s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:03 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 Jul 30 16:54:03 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (f5153668-5b43-458d-b37b-7c7f437a72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b406cd-43ef-4f91-90a1-b530ee99556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b406cd-43ef-4f91-90a1-b530ee99556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981169662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8acced-0d57-4932-804f-7bcabff2025e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:04Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9422e089-0e82-4d79-bc2e-6290635fe17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9422e089-0e82-4d79-bc2e-6290635fe17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e09bc3-05fd-4d52-aeab-32383fce9e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e09bc3-05fd-4d52-aeab-32383fce9e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8acced-0d57-4932-804f-7bcabff2025e', 'volume_name': 'volume-8e8acced-0d57-4932-804f-7bcabff2025e', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ed67af-5382-4f87-8d37-4a7cf6adf809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ed67af-5382-4f87-8d37-4a7cf6adf809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fdcfce-2299-4082-a234-6c9d3df7242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Volume 8e8acced-0d57-4932-804f-7bcabff2025e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8acced-0d57-4932-804f-7bcabff2025e', 'volume_size': 1} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:04 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12" returned: 0 in 0.266s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089879943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5010abb-696a-46c6-bb02-e803a7283c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:03Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Creating volume b5010abb-696a-46c6-bb02-e803a7283c44 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:04 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 1073741824 Jul 30 16:54:04 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10caf402-b304-45ef-ad74-c5e7ae1e51ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549af897-4215-409e-9b05-84cc243cae12', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bd4499-85b4-417d-9ec6-d5cc1193cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Volume volume-549af897-4215-409e-9b05-84cc243cae12 (549af897-4215-409e-9b05-84cc243cae12): created successfully Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0bd4499-85b4-417d-9ec6-d5cc1193cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (7621b395-279e-4f63-a0a9-7e325021d88a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-cd019253-d8a9-4d35-bb7e-5dfadc2961c8 tempest-CreateVolumesFromImageTest-1990370073 None] Created volume successfully. Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-2d948839-8dd5-4143-a9f4-3ed10b6a9088-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-2d948839-8dd5-4143-a9f4-3ed10b6a9088-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (ed2b815c-858b-44b7-8016-355cff498c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1187f897-6a73-4991-a0be-d90d104cd2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1187f897-6a73-4991-a0be-d90d104cd2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-41511456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a153719a-7da6-4b60-960c-2fdf0b720683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:04Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f471ec-f163-41a5-b485-4217978f6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f471ec-f163-41a5-b485-4217978f6976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98ca94a-5dba-4f4b-8986-7b3c5e342310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98ca94a-5dba-4f4b-8986-7b3c5e342310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a153719a-7da6-4b60-960c-2fdf0b720683', 'volume_name': 'volume-a153719a-7da6-4b60-960c-2fdf0b720683', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ac3d2f-1646-48e9-af0d-e545099dceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ac3d2f-1646-48e9-af0d-e545099dceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d35730d-92f4-44a5-a829-36b8dd489ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:04 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Volume a153719a-7da6-4b60-960c-2fdf0b720683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a153719a-7da6-4b60-960c-2fdf0b720683', 'volume_size': 1} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-2d948839-8dd5-4143-a9f4-3ed10b6a9088" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-2d948839-8dd5-4143-a9f4-3ed10b6a9088" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d4bbd7-d7b0-4c0a-b7af-94de248c9a98]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-quobyte-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:04 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" acquired by "delete_volume" :: waited 0.036s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:04 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5120da-fc88-40bc-a168-f6c3ad6b0c5a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 1073741824" returned: 0 in 0.878s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 Jul 30 16:54:05 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:05 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (ce4c4ffa-88fd-44b9-8ef6-963762e46a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a365c3bd-8ac7-40a4-a125-a5e8ba3a2ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:05 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088" returned: 0 in 0.574s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a365c3bd-8ac7-40a4-a125-a5e8ba3a2ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938473183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:05Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8922bcea-1abe-40b9-9a62-81969344a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:05 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088 Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8922bcea-1abe-40b9-9a62-81969344a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:05 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe26524-a497-4342-8701-edf769d0f255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe26524-a497-4342-8701-edf769d0f255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a', 'volume_name': 'volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30bb925-c50c-4206-ac3b-2249913b80bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30bb925-c50c-4206-ac3b-2249913b80bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12f0c7a-9372-4321-a039-43535c88e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:05 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Volume 7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a', 'volume_size': 1} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:05 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981169662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8acced-0d57-4932-804f-7bcabff2025e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:04Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Creating volume 8e8acced-0d57-4932-804f-7bcabff2025e {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:05 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca34728-916f-430b-b9e6-f5a4447f16f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5010abb-696a-46c6-bb02-e803a7283c44', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:05 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e 1073741824 Jul 30 16:54:05 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b03bcd3-b9e1-45e5-b2fd-37bfd3511622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" returned: 0 in 0.592s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Volume volume-b5010abb-696a-46c6-bb02-e803a7283c44 (b5010abb-696a-46c6-bb02-e803a7283c44): created successfully Jul 30 16:54:05 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3 Jul 30 16:54:05 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b03bcd3-b9e1-45e5-b2fd-37bfd3511622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (eef47abc-de26-424d-9558-0246aa5c1e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:05 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-612d2a2c-afed-4f4e-92dd-30e1bbc30c58 tempest-CreateVolumesFromImageTest-1990370073 None] Created volume successfully. Jul 30 16:54:05 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2d948839-8dd5-4143-a9f4-3ed10b6a9088" returned: 0 in 0.373s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-2d948839-8dd5-4143-a9f4-3ed10b6a9088" released by "delete_volume" :: held 1.011s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['022077ac-237d-4bde-9851-fc0a51769367', 'c68fd52f-d107-4406-8d5e-05842e2ef03d', '6bb792a9-c0f2-498e-bcb3-8c53041fb5ad', 'dfff92bb-3ac4-4ef9-8483-fa1da752b7b5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:05 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:05 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:05 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" returned: 0 in 0.354s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3" released by "delete_volume" :: held 1.055s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:05 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Created reservations ['5fe33d30-686b-4529-9d6b-ddb5f10e5cf3', '1dc311d0-2ff0-4783-9914-6bbe4f68d207', '32fbb6d1-2322-43f0-820f-f50a8f164ac5', 'e6072615-b0c1-4e0e-92dc-9fdae8d55d05'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:06 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e 1073741824" returned: 0 in 0.585s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:06 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:06 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleted volume successfully. Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c449a7af-6a14-4aaa-9453-b2b07e7e3f6a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-2d948839-8dd5-4143-a9f4-3ed10b6a9088-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e Jul 30 16:54:06 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.281s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Deleted volume successfully. Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-293863f6-0ba2-4825-b97b-15fe37be9b81 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-841e068c-a7cc-4abc-aef5-2ac9ff1d7fd3-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:06 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-41511456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a153719a-7da6-4b60-960c-2fdf0b720683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:04Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Creating volume a153719a-7da6-4b60-960c-2fdf0b720683 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:06 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fdcfce-2299-4082-a234-6c9d3df7242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8acced-0d57-4932-804f-7bcabff2025e', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:06 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 1073741824 Jul 30 16:54:06 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13943749-cdc6-4ed5-bec9-126252d73352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Volume volume-8e8acced-0d57-4932-804f-7bcabff2025e (8e8acced-0d57-4932-804f-7bcabff2025e): created successfully Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13943749-cdc6-4ed5-bec9-126252d73352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (f5153668-5b43-458d-b37b-7c7f437a72f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d8381d36-c5c5-4bf6-91e8-ca60964fb0f4 tempest-CreateVolumesFromImageTest-1990370073 None] Created volume successfully. Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-6c1e0443-b420-4192-bfa2-b31f50dbe492-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-6c1e0443-b420-4192-bfa2-b31f50dbe492-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-6c1e0443-b420-4192-bfa2-b31f50dbe492" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-6c1e0443-b420-4192-bfa2-b31f50dbe492" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e512da-874c-42aa-8982-010c102f4b39]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:06 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 Jul 30 16:54:06 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:06 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 1073741824" returned: 0 in 0.522s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 Jul 30 16:54:07 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "cinder-quobyte-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718f2de-8b90-4629-b40d-ea5ff61ee113]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492" returned: 0 in 0.448s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492 Jul 30 16:54:07 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b Jul 30 16:54:07 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938473183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13f7e4888c3048708deb0b973dcf2e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:05Z,use_quota=True,user_id='3d3a8b3c63f4483984d6fc8ba86342c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Creating volume 7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:07 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d35730d-92f4-44a5-a829-36b8dd489ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a153719a-7da6-4b60-960c-2fdf0b720683', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a1a73d-8ca0-4911-949c-1295412e9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:07 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a 1073741824 Jul 30 16:54:07 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Volume volume-a153719a-7da6-4b60-960c-2fdf0b720683 (a153719a-7da6-4b60-960c-2fdf0b720683): created successfully Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a1a73d-8ca0-4911-949c-1295412e9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (ed2b815c-858b-44b7-8016-355cff498c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Flow 'volume_create_manager' (23bee836-816a-4e50-8a9b-37443087412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094356f0-3844-4ef3-8429-3d722f9e39d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:07 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094356f0-3844-4ef3-8429-3d722f9e39d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-663722095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11458503-bcf5-4f88-9e7d-178933f9bbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f29df41e5ab4df7b17cccc96cafcf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:07Z,use_quota=True,user_id='b2720c1585d5482ca22be73bd2d8d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c86598a-0a65-4ef2-b767-6f7038c17ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c86598a-0a65-4ef2-b767-6f7038c17ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6cb4a3-f476-4401-8e82-490f03a032c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6cb4a3-f476-4401-8e82-490f03a032c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11458503-bcf5-4f88-9e7d-178933f9bbcb', 'volume_name': 'volume-11458503-bcf5-4f88-9e7d-178933f9bbcb', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abb2d60-2dc3-49ec-a292-72a4ac66d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abb2d60-2dc3-49ec-a292-72a4ac66d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75548eeb-9855-4aee-9b05-8a9fa3f6d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:07 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Volume 11458503-bcf5-4f88-9e7d-178933f9bbcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11458503-bcf5-4f88-9e7d-178933f9bbcb', 'volume_size': 1} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b" returned: 0 in 0.477s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5b9383d2-8328-47c9-ba73-f92a840675b1 tempest-CreateVolumesFromImageTest-1990370073 None] Created volume successfully. Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6c1e0443-b420-4192-bfa2-b31f50dbe492" returned: 0 in 0.457s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-6c1e0443-b420-4192-bfa2-b31f50dbe492" released by "delete_volume" :: held 0.952s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:07 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b Jul 30 16:54:07 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['18f63fa9-957a-4652-98d0-a2db43750f2f', 'f87f2f47-df72-47b4-b832-add222130ec7', '1f3732d6-cefe-481d-a2ef-2d4d5c035578', '3bc03b39-4919-403c-8dc6-ad3837f2e8e1'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:07 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:07 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-f36fe62d-e3ad-457b-b9b8-267eb28a048c" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-f36fe62d-e3ad-457b-b9b8-267eb28a048c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleting offline snapshot 6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a of volume f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:07 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] snapshot_file for this snap is: volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b" returned: 0 in 0.345s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1b7315-a449-4bf1-a898-46e23ea0e673]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:08 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-quobyte-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b" released by "delete_volume" :: held 0.887s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a 1073741824" returned: 0 in 0.595s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Created reservations ['98cfe79a-a33d-42f6-8857-08231fe33855', '63b8f7eb-8f0f-4456-abe9-7915f1497a1b', '6e347525-0869-411b-9522-f1999110af6f', '75359e0b-420c-410d-963d-2119605b0006'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:08 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a Jul 30 16:54:08 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a Jul 30 16:54:08 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:08 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.315s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleted volume successfully. Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-0db78e7b-33a5-47cf-9030-5d198b4d11d7 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-6c1e0443-b420-4192-bfa2-b31f50dbe492-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:08 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:08 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:08 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a" returned: 0 in 0.455s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-663722095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11458503-bcf5-4f88-9e7d-178933f9bbcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f29df41e5ab4df7b17cccc96cafcf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:07Z,use_quota=True,user_id='b2720c1585d5482ca22be73bd2d8d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Creating volume 11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:08 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:08 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" returned: 0 in 0.592s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:08 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb 1073741824 Jul 30 16:54:08 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:08 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12f0c7a-9372-4321-a039-43535c88e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066cef3-8781-4cff-8b76-f466d9546719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.446s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[56618d83-caa5-4555-9a83-385766a66993]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Deleted volume successfully. Jul 30 16:54:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Volume volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a (7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a): created successfully Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066cef3-8781-4cff-8b76-f466d9546719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Flow 'volume_create_manager' (ce4c4ffa-88fd-44b9-8ef6-963762e46a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b5d48ddb-0309-45d3-a73c-2d96f8351d19 tempest-CinderUnicodeTest-1321868906 None] Lock "cinder-8692bbc6-c6c3-4dd6-919e-1c36d8d6209b-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4e15fac7-cd1c-4c5b-813d-bb5d07ec247a tempest-CreateVolumesFromImageTest-1990370073 None] Created volume successfully. Jul 30 16:54:08 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c Jul 30 16:54:08 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:09 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb 1073741824" returned: 0 in 0.641s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:09 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c" returned: 0 in 0.576s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:09 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb Jul 30 16:54:09 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:09 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a Jul 30 16:54:09 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:09 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb" returned: 0 in 0.265s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75548eeb-9855-4aee-9b05-8a9fa3f6d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11458503-bcf5-4f88-9e7d-178933f9bbcb', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e70373-5755-4e25-a3f3-7a6aa9dba727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:09 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Volume volume-11458503-bcf5-4f88-9e7d-178933f9bbcb (11458503-bcf5-4f88-9e7d-178933f9bbcb): created successfully Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e70373-5755-4e25-a3f3-7a6aa9dba727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Flow 'volume_create_manager' (23bee836-816a-4e50-8a9b-37443087412f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:09 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-25449ef4-600a-4c81-8448-b70cb3201fad tempest-VolumeDependencyTests-2061325297 None] Created volume successfully. Jul 30 16:54:09 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" returned: 0 in 0.372s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:09 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a Jul 30 16:54:09 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-quobyte-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:09 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c.6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" returned: 0 in 0.281s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc67b8-17ca-4b55-8665-deea1e658020]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a" released by "_delete_snapshot" :: held 2.005s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:09 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-f36fe62d-e3ad-457b-b9b8-267eb28a048c" released by "delete_snapshot" :: held 2.040s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:10 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a Jul 30 16:54:10 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['ae4ce6f6-ae78-4b54-87d3-286d63597e89', 'f03466ff-e2a5-479a-a48f-618934edfe6e', '67949fce-1b21-4f92-b641-f312a4c955ef', '4f0f068b-e373-4367-a12e-df7f2b44926c'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Delete snapshot completed successfully. Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-fe6df79b-34ea-48eb-9080-3c24dbccbce1 tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-6d5e1f75-b8c5-4e6e-b365-a1761bcb7e6a-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:10 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a" returned: 0 in 0.387s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:10 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a Jul 30 16:54:10 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:10 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a" released by "delete_volume" :: held 0.693s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Created reservations ['0f549afd-c68b-4006-99d7-0b5018c7a099', '12cd922b-2ec8-42fb-8d35-7de1187cbd1f', 'ca457f79-59bd-4efa-bd4c-162342c39568', 'ab7b3aa9-a362-4a2c-9f79-b3d26bdc5a24'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:10 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:10 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Creating offline snapshot 4553e4c2-b4af-4594-877e-a7386de0e6e2 of volume 11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b2cef-984d-4e6b-984b-42c1a030decd]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-a153719a-7da6-4b60-960c-2fdf0b720683-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-a153719a-7da6-4b60-960c-2fdf0b720683-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:11 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Deleted volume successfully. Jul 30 16:54:11 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb Jul 30 16:54:11 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-quobyte-a153719a-7da6-4b60-960c-2fdf0b720683" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-09dbd1c0-bd04-4eca-b9ee-f8f52eaf1f0c tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-7ce487a2-daae-4ac8-864a-f6ab6b0c0e8a-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-a153719a-7da6-4b60-960c-2fdf0b720683" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-f36fe62d-e3ad-457b-b9b8-267eb28a048c-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e874f5-1411-4b1a-8972-e03d2dc88f05]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-f36fe62d-e3ad-457b-b9b8-267eb28a048c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "cinder-quobyte-f36fe62d-e3ad-457b-b9b8-267eb28a048c" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-f36fe62d-e3ad-457b-b9b8-267eb28a048c" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:11 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 Jul 30 16:54:11 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fbc4fa-a952-4331-9c7b-8276e556cca9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:11 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb" returned: 0 in 0.526s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:11 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 1G Jul 30 16:54:11 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c Jul 30 16:54:11 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683" returned: 0 in 0.418s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:11 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683 Jul 30 16:54:11 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c" returned: 0 in 0.418s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:11 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c Jul 30 16:54:11 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 1G" returned: 0 in 0.475s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11458503-bcf5-4f88-9e7d-178933f9bbcb -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:11 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a153719a-7da6-4b60-960c-2fdf0b720683" returned: 0 in 0.313s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:11 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11458503-bcf5-4f88-9e7d-178933f9bbcb -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 Jul 30 16:54:11 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-a153719a-7da6-4b60-960c-2fdf0b720683" released by "delete_volume" :: held 0.798s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:11 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Created reservations ['82d69899-cfe1-49b6-ab73-fdea731258f8', 'bda3d25a-dfd2-4444-b654-68f576a4b0d7', 'c68d752d-7a13-489f-a423-5d8652808fc7', '5df91af7-13aa-40f9-b8ee-4426d7160017'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:12 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f36fe62d-e3ad-457b-b9b8-267eb28a048c" returned: 0 in 0.298s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-quobyte-f36fe62d-e3ad-457b-b9b8-267eb28a048c" released by "delete_volume" :: held 0.805s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:12 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Created reservations ['0b740fad-077f-481b-aa33-e318ce792cff', '1faa196a-e3ea-4287-9fe4-97726d41de79', 'f89c023b-12e8-4dfb-b1c3-bf73e231ae29', 'a37e318d-0e98-4962-b1f9-df3ff2a1053d'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-8e8acced-0d57-4932-804f-7bcabff2025e-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-8e8acced-0d57-4932-804f-7bcabff2025e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11458503-bcf5-4f88-9e7d-178933f9bbcb -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2" returned: 0 in 0.459s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:12 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 is being set with open permissions: ugo+rw Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:12 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-quobyte-8e8acced-0d57-4932-804f-7bcabff2025e" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:12 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 Jul 30 16:54:12 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-8e8acced-0d57-4932-804f-7bcabff2025e" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:12 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.339s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Deleted volume successfully. Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ee124-d239-45c0-b3e0-716e06817ae2]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ead14de9-90a0-40b1-9544-54879d5e57e8 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-a153719a-7da6-4b60-960c-2fdf0b720683-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:12 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.301s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Deleted volume successfully. Jul 30 16:54:12 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e Jul 30 16:54:12 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-651df0df-3300-4dd8-ac88-f2c90797c72a tempest-CreateVolumesFromSnapshotTest-1924381144 None] Lock "cinder-f36fe62d-e3ad-457b-b9b8-267eb28a048c-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:12 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2" returned: 0 in 0.356s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info Jul 30 16:54:12 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:12 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e" returned: 0 in 0.506s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:12 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e Jul 30 16:54:12 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:13 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info is being set with open permissions: ugo+rw Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:13 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info Jul 30 16:54:13 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:13 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8e8acced-0d57-4932-804f-7bcabff2025e" returned: 0 in 0.308s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-8e8acced-0d57-4932-804f-7bcabff2025e" released by "delete_volume" :: held 0.885s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:13 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.info" returned: 0 in 0.307s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:13 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d8cd1274-9c40-4dec-b5a2-7b2e412dbe54 tempest-VolumeDependencyTests-2061325297 None] Create snapshot completed successfully Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Created reservations ['f919685d-c991-4211-923e-b3c69aed986b', '739f5165-5739-485a-b8d5-f8cbbb594b26', '5aada827-8629-4116-8632-5729203126b6', '52fdca95-0489-48ad-a88d-332ffd3361a8'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:13 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:13 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:13 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:13 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Deleted volume successfully. Jul 30 16:54:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ec6ce483-a92d-48d1-bfbe-cf508cf89754 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-8e8acced-0d57-4932-804f-7bcabff2025e-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-b5010abb-696a-46c6-bb02-e803a7283c44-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-b5010abb-696a-46c6-bb02-e803a7283c44-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-quobyte-b5010abb-696a-46c6-bb02-e803a7283c44" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-b5010abb-696a-46c6-bb02-e803a7283c44" acquired by "delete_volume" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f7310-ba74-48fb-b2d8-3d2a8273b7fe]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Flow 'volume_create_manager' (7dfa8b42-afa7-46ef-9775-2518ede899ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ea1792-4599-4fe2-9aff-8a33266165c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ea1792-4599-4fe2-9aff-8a33266165c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-280995171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a83fa7b-fe16-4987-965e-f22dbcdb14aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f29df41e5ab4df7b17cccc96cafcf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4553e4c2-b4af-4594-877e-a7386de0e6e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:15Z,use_quota=True,user_id='b2720c1585d5482ca22be73bd2d8d2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5193e62-74c8-4d01-acaa-adaf2bab66cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5193e62-74c8-4d01-acaa-adaf2bab66cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54b561d-ea7f-428d-88dd-fd785f2c1a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54b561d-ea7f-428d-88dd-fd785f2c1a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a83fa7b-fe16-4987-965e-f22dbcdb14aa', 'volume_name': 'volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa', 'volume_size': 1, 'snapshot_id': '4553e4c2-b4af-4594-877e-a7386de0e6e2'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a2e1aa-bcb2-44fc-98d8-3a15d235a3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a2e1aa-bcb2-44fc-98d8-3a15d235a3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29edb3a4-e349-4fa0-880e-6d85254948c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Volume 2a83fa7b-fe16-4987-965e-f22dbcdb14aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa', 'volume_size': 1, 'snapshot_id': '4553e4c2-b4af-4594-877e-a7386de0e6e2'} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-quobyte-4553e4c2-b4af-4594-877e-a7386de0e6e2-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:14 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-4553e4c2-b4af-4594-877e-a7386de0e6e2-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Creating volume 2a83fa7b-fe16-4987-965e-f22dbcdb14aa from snapshot 4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:14 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-quobyte-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] snapshot: 4553e4c2-b4af-4594-877e-a7386de0e6e2, volume: 2a83fa7b-fe16-4987-965e-f22dbcdb14aa, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f129f8-1f75-4678-8a5b-8cf35ac61f51]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 Jul 30 16:54:15 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44" returned: 0 in 0.529s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44 Jul 30 16:54:15 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2" returned: 0 in 0.480s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11458503-bcf5-4f88-9e7d-178933f9bbcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad940cd-a094-4880-9107-2cfe93cf8c9b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-b5010abb-696a-46c6-bb02-e803a7283c44" returned: 0 in 0.321s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-b5010abb-696a-46c6-bb02-e803a7283c44" released by "delete_volume" :: held 0.940s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:15 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb Jul 30 16:54:15 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Created reservations ['bfc28eca-0b3f-4ead-bcb5-71ea5555d366', '6d151005-0203-4ab1-9766-0c99d1d8c5c3', 'd3169497-e575-415f-9d05-442921e64080', 'db3da5f4-d74c-4c49-82c1-d0b3f5ad2543'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:15 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:15 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-549af897-4215-409e-9b05-84cc243cae12-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-549af897-4215-409e-9b05-84cc243cae12-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "cinder-quobyte-549af897-4215-409e-9b05-84cc243cae12" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-549af897-4215-409e-9b05-84cc243cae12" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6881df23-9580-454e-b421-1545085609bb]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:16 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.299s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:16 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Deleted volume successfully. Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-89a448c8-76e7-4141-afa0-d4f075237493 tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-b5010abb-696a-46c6-bb02-e803a7283c44-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:16 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb" returned: 0 in 0.669s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:16 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa Jul 30 16:54:16 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:16 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 Jul 30 16:54:16 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:16 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12" returned: 0 in 0.417s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:16 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12 Jul 30 16:54:16 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:16 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-549af897-4215-409e-9b05-84cc243cae12" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-quobyte-549af897-4215-409e-9b05-84cc243cae12" released by "delete_volume" :: held 0.845s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:16 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Created reservations ['26f54e1b-863c-425f-98d1-7f7764f71747', '9ed7e672-304f-4d16-9a4f-84f2275eadd9', 'fd31d1ff-b2c8-4ddb-b91a-523ca8fb57f4', '59f7ed12-b7fb-4850-b131-ba5d65d81781'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:17 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:17 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:17 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.617s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:17 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Deleted volume successfully. Jul 30 16:54:17 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d26bd0f5-7d83-45b2-830c-71475695f0ee tempest-CreateVolumesFromImageTest-1990370073 None] Lock "cinder-549af897-4215-409e-9b05-84cc243cae12-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:21 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" returned: 0 in 5.788s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:21 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:54:21 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Converted 1024.00 MB image at 176.88 MB/s Jul 30 16:54:21 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa is being set with open permissions: ugo+rw Jul 30 16:54:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:21 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa Jul 30 16:54:21 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:22 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" returned: 0 in 0.284s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" released by "_copy_volume_from_snapshot" :: held 7.343s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-4553e4c2-b4af-4594-877e-a7386de0e6e2-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" released by "_create_volume_from_snapshot" :: held 7.439s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.459s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29edb3a4-e349-4fa0-880e-6d85254948c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa', 'volume_size': 1, 'snapshot_id': '4553e4c2-b4af-4594-877e-a7386de0e6e2'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b090d4ae-df9f-42c8-bda5-046fdba56909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:22 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Volume volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa (2a83fa7b-fe16-4987-965e-f22dbcdb14aa): created successfully Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b090d4ae-df9f-42c8-bda5-046fdba56909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Flow 'volume_create_manager' (7dfa8b42-afa7-46ef-9775-2518ede899ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ccf78a3b-da22-4e42-9af4-423f1497efe3 tempest-VolumeDependencyTests-2061325297 None] Created volume successfully. Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-4553e4c2-b4af-4594-877e-a7386de0e6e2-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-4553e4c2-b4af-4594-877e-a7386de0e6e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-quobyte-11458503-bcf5-4f88-9e7d-178933f9bbcb" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-11458503-bcf5-4f88-9e7d-178933f9bbcb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-quobyte-4553e4c2-b4af-4594-877e-a7386de0e6e2" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-4553e4c2-b4af-4594-877e-a7386de0e6e2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Deleting offline snapshot 4553e4c2-b4af-4594-877e-a7386de0e6e2 of volume 11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] snapshot_file for this snap is: volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49dfcc-8eaf-4662-acdb-9ea6b11ca029]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:23 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 Jul 30 16:54:23 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Flow 'volume_create_manager' (8aef2da9-f61e-40ac-9bac-67a2443d76d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2aab630-6cdb-4e34-a447-d0c3d4cc3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2aab630-6cdb-4e34-a447-d0c3d4cc3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe794801-ea1b-4422-9367-59eb07a5962f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15da34dc9f69483eb7f380b33c20322d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:23Z,use_quota=True,user_id='1648e8463f8f445587c4b83ff4a04257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005266fb-099f-465e-8025-5554827b5100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005266fb-099f-465e-8025-5554827b5100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7525d1-9e96-4c5d-a95c-f6c194df193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.image.glance [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Creating Keystone auth plugin from conf {{(pid=88380) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 30 16:54:23 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2" returned: 0 in 0.536s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11458503-bcf5-4f88-9e7d-178933f9bbcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[521cbd06-7194-4704-843f-f059128c989b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7525d1-9e96-4c5d-a95c-f6c194df193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe794801-ea1b-4422-9367-59eb07a5962f', 'volume_name': 'volume-fe794801-ea1b-4422-9367-59eb07a5962f', 'volume_size': 1, 'image_id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16081ab3bdff6f270f4a4b22558db71e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15da34dc9f69483eb7f380b33c20322d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc521b2dd44e79813d86dbe09df551f262d40d38a987960808884026f5abc4ad793c74333682700bc5bab71f2634afcccada561028abd711e438d70100c390af', 'id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'created_at': datetime.datetime(2026, 7, 30, 14, 54, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 54, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556/file', 'properties': {}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f99da1-ba74-4332-bf67-7fd864d93210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f99da1-ba74-4332-bf67-7fd864d93210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2191e9da-fbc2-49d2-bc41-d7cdaeeef4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:23 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Volume fe794801-ea1b-4422-9367-59eb07a5962f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe794801-ea1b-4422-9367-59eb07a5962f', 'volume_size': 1, 'image_id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16081ab3bdff6f270f4a4b22558db71e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15da34dc9f69483eb7f380b33c20322d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc521b2dd44e79813d86dbe09df551f262d40d38a987960808884026f5abc4ad793c74333682700bc5bab71f2634afcccada561028abd711e438d70100c390af', 'id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'created_at': datetime.datetime(2026, 7, 30, 14, 54, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 54, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556/file', 'properties': {}}, 'image_service': } Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Trying to clone fe794801-ea1b-4422-9367-59eb07a5962f from image dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'metadata': {}}]). {{(pid=88380) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 30 16:54:23 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb Jul 30 16:54:23 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 30 16:54:23 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Image download 0.00 MB at 0.00 MB/s Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21c039-b899-4de9-8e6e-ca96ff54fa09]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:24 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD Jul 30 16:54:24 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:24 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb" returned: 0 in 0.721s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:24 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 Jul 30 16:54:24 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:24 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-0780f7a2-8ece-433d-860d-84d01c0ad6fe tempest-ProjectAdminTests-1667124567 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.74658203125, 'free_capacity_gb': 1775.74658203125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88380) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 30 16:54:24 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD Jul 30 16:54:24 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:24 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2" returned: 0 in 0.469s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:24 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Temporary image dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 is fetched for user 1648e8463f8f445587c4b83ff4a04257. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 30 16:54:24 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2 Jul 30 16:54:24 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a0760-a124-4afe-9d65-a58dba6d16bf]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:25 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD Jul 30 16:54:25 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:25 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb.4553e4c2-b4af-4594-877e-a7386de0e6e2" returned: 0 in 0.432s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-4553e4c2-b4af-4594-877e-a7386de0e6e2" released by "_delete_snapshot" :: held 2.313s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-11458503-bcf5-4f88-9e7d-178933f9bbcb" released by "delete_snapshot" :: held 2.351s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Created reservations ['61555813-4797-4d14-9215-840928af8607', 'c5949688-be66-4d67-b9f5-bc22cecdaf29', 'd19a4c7c-f4b6-43a7-88d0-0a407f083bdc', '8d97b05d-254b-4af7-8ebf-e63c6e00cc73'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:25 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:25 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Delete snapshot completed successfully. Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-45f8ccf3-d333-4b33-9a55-d96b5b5e3149 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-4553e4c2-b4af-4594-877e-a7386de0e6e2-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:25 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD Jul 30 16:54:25 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:25 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe794801-ea1b-4422-9367-59eb07a5962f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15da34dc9f69483eb7f380b33c20322d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:23Z,use_quota=True,user_id='1648e8463f8f445587c4b83ff4a04257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Creating volume fe794801-ea1b-4422-9367-59eb07a5962f {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:25 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:25 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f 1073741824 Jul 30 16:54:25 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-11458503-bcf5-4f88-9e7d-178933f9bbcb-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-11458503-bcf5-4f88-9e7d-178933f9bbcb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-quobyte-11458503-bcf5-4f88-9e7d-178933f9bbcb" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-11458503-bcf5-4f88-9e7d-178933f9bbcb" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8941780-6b55-4d32-9c56-9406cbde92d7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:26 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f 1073741824" returned: 0 in 0.577s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:26 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb Jul 30 16:54:26 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:26 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f Jul 30 16:54:26 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:26 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb" returned: 0 in 0.459s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:26 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:26 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb Jul 30 16:54:26 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f" returned: 0 in 0.305s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Attempting download of dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'metadata': {}}])) to volume fe794801-ea1b-4422-9367-59eb07a5962f. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b77344-1151-4b15-b4ed-1c76fb553e66]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii Jul 30 16:54:27 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:27 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-11458503-bcf5-4f88-9e7d-178933f9bbcb" returned: 0 in 0.332s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-11458503-bcf5-4f88-9e7d-178933f9bbcb" released by "delete_volume" :: held 0.866s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Created reservations ['3a00f857-2020-4c54-8573-86c7e0f1b7c8', '849bcda0-1ac2-4d07-afb1-1eec6556a04c', '3427cc6a-e2e4-415e-a630-2df4ad87bb78', '42e662fe-dc64-4cd5-a553-586722d27794'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:27 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:27 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii" returned: 0 in 0.471s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-2a83fa7b-fe16-4987-965e-f22dbcdb14aa-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-2a83fa7b-fe16-4987-965e-f22dbcdb14aa-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:27 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii Jul 30 16:54:27 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "cinder-quobyte-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" acquired by "delete_volume" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daeaf4a-38f7-4b37-a29f-bff275e5ed0b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.475s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:27 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Deleted volume successfully. Jul 30 16:54:27 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa Jul 30 16:54:27 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-9e7e7f1c-4221-4689-be5e-fcf5892dee23 tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-11458503-bcf5-4f88-9e7d-178933f9bbcb-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:27 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii" returned: 1 in 0.447s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_i_9h62ii' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[713585ea-5c84-4162-a5d1-473727732ad2]: (4, 'raw') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:27 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD Jul 30 16:54:27 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" returned: 0 in 0.487s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa Jul 30 16:54:28 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD Jul 30 16:54:28 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" returned: 0 in 0.326s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-quobyte-2a83fa7b-fe16-4987-965e-f22dbcdb14aa" released by "delete_volume" :: held 0.876s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Created reservations ['bb2884f4-290f-41ec-a0c0-184c9dab1bf5', 'f89aac83-55ff-46a8-a0a3-da5d353762d7', '6829c300-c173-4612-b78d-9006f7c093d2', 'f4f3b0cf-cd94-47a6-9527-4f3c62cc8a0a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:28 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD" returned: 1 in 0.484s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 was raw, converting to qcow2 {{(pid=88380) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:28 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f Jul 30 16:54:28 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:28 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:28 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Deleted volume successfully. Jul 30 16:54:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-de1ee0d9-a86f-44cf-92b7-a29156ba66ba tempest-VolumeDependencyTests-2061325297 None] Lock "cinder-2a83fa7b-fe16-4987-965e-f22dbcdb14aa-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:29 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f" returned: 0 in 0.620s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcf6249e-61ff-4ff6-ac5d-2573b2a5b556_cej23hhzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:54:29 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Converted 0.00 MB image at 0.00 MB/s Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:29 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f 1G Jul 30 16:54:29 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:29 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f 1G" returned: 0 in 0.446s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Downloaded image dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'metadata': {}}])) to volume fe794801-ea1b-4422-9367-59eb07a5962f successfully. {{(pid=88380) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Temporary image dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 for user 1648e8463f8f445587c4b83ff4a04257 is deleted. {{(pid=88380) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.volume.volume_utils [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Marking volume fe794801-ea1b-4422-9367-59eb07a5962f as bootable. {{(pid=88380) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Copying metadata from image dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 to fe794801-ea1b-4422-9367-59eb07a5962f. {{(pid=88380) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Creating volume glance metadata for volume fe794801-ea1b-4422-9367-59eb07a5962f backed by image dcf6249e-61ff-4ff6-ac5d-2573b2a5b556 with: {'image_id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '16081ab3bdff6f270f4a4b22558db71e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88380) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2191e9da-fbc2-49d2-bc41-d7cdaeeef4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe794801-ea1b-4422-9367-59eb07a5962f', 'volume_size': 1, 'image_id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16081ab3bdff6f270f4a4b22558db71e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15da34dc9f69483eb7f380b33c20322d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc521b2dd44e79813d86dbe09df551f262d40d38a987960808884026f5abc4ad793c74333682700bc5bab71f2634afcccada561028abd711e438d70100c390af', 'id': 'dcf6249e-61ff-4ff6-ac5d-2573b2a5b556', 'created_at': datetime.datetime(2026, 7, 30, 14, 54, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 30, 14, 54, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcf6249e-61ff-4ff6-ac5d-2573b2a5b556/file', 'properties': {}}, 'image_service': }' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:29 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef2ba95-cb76-4bc3-976a-77cad2343bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:29 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Volume volume-fe794801-ea1b-4422-9367-59eb07a5962f (fe794801-ea1b-4422-9367-59eb07a5962f): created successfully Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef2ba95-cb76-4bc3-976a-77cad2343bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Flow 'volume_create_manager' (8aef2da9-f61e-40ac-9bac-67a2443d76d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:30 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2b1394e4-d96b-4f12-9d3d-e7c0480776fa tempest-VolumeImageDependencyTests-904079201 None] Created volume successfully. Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (4cfe1b53-1572-4c35-85a0-c612bf48b000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75245b81-4531-4d42-a7ad-94438c4568dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75245b81-4531-4d42-a7ad-94438c4568dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924652837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7b688c-b2a1-4739-995b-29f984cbc4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:30Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902db257-9706-405a-9d52-abe8c533c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902db257-9706-405a-9d52-abe8c533c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f512c2-3f19-4e24-8f2e-726420353faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f512c2-3f19-4e24-8f2e-726420353faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7b688c-b2a1-4739-995b-29f984cbc4a0', 'volume_name': 'volume-de7b688c-b2a1-4739-995b-29f984cbc4a0', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf21dcc0-4ec2-4201-9d27-136f8a746da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf21dcc0-4ec2-4201-9d27-136f8a746da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e32c346-91fd-4058-be43-5ee8d55422c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:30 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Volume de7b688c-b2a1-4739-995b-29f984cbc4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7b688c-b2a1-4739-995b-29f984cbc4a0', 'volume_size': 1} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-924652837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7b688c-b2a1-4739-995b-29f984cbc4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:30Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Creating volume de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:30 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:30 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 1073741824 Jul 30 16:54:30 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Acquiring lock "cinder-fe794801-ea1b-4422-9367-59eb07a5962f-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Lock "cinder-fe794801-ea1b-4422-9367-59eb07a5962f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:30 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Acquiring lock "cinder-quobyte-fe794801-ea1b-4422-9367-59eb07a5962f" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Lock "cinder-quobyte-fe794801-ea1b-4422-9367-59eb07a5962f" acquired by "delete_volume" :: waited 0.030s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1910e393-56fe-4145-a98a-f7c6123d72f7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f Jul 30 16:54:31 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 1073741824" returned: 0 in 0.758s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 Jul 30 16:54:31 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f" returned: 0 in 0.528s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:31 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f Jul 30 16:54:31 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:31 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0" returned: 0 in 0.353s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=293,cinder:SELECT=194,cinder:DELETE=28,cinder:INSERT=70 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e32c346-91fd-4058-be43-5ee8d55422c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7b688c-b2a1-4739-995b-29f984cbc4a0', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fccd3-adb8-4c51-bbb6-cfd7519fa9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:31 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Volume volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 (de7b688c-b2a1-4739-995b-29f984cbc4a0): created successfully Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428fccd3-adb8-4c51-bbb6-cfd7519fa9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (4cfe1b53-1572-4c35-85a0-c612bf48b000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4a68b0b8-4ff8-4c57-a36f-1d222729791f tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:54:31 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-fe794801-ea1b-4422-9367-59eb07a5962f" returned: 0 in 0.335s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Lock "cinder-quobyte-fe794801-ea1b-4422-9367-59eb07a5962f" released by "delete_volume" :: held 0.924s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:31 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=207,cinder:UPDATE=253,cinder:INSERT=76,cinder:DELETE=20 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Created reservations ['eb46d75d-f7f7-4bcc-802d-86481d687cf4', '7341f36b-b062-4a48-91ff-2b48f6edb8ff', '23e177a7-3430-499e-9e2f-a02a7ba1cad7', 'bfc13e9b-42e7-4e5b-8a87-bee9eb9a04e9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:32 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:32 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:32 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.391s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:32 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Deleted volume successfully. Jul 30 16:54:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-32b45d08-f50d-4e4f-a595-e8e6933d2852 tempest-VolumeImageDependencyTests-904079201 None] Lock "cinder-fe794801-ea1b-4422-9367-59eb07a5962f-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Creating offline snapshot a8b101aa-c89c-40a3-a03b-03843cfce880 of volume de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1095f77-0eb3-48da-a65a-5462cc40ae1a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:33 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 Jul 30 16:54:33 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:33 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0" returned: 0 in 0.556s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:33 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 1G Jul 30 16:54:33 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 1G" returned: 0 in 0.604s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 Jul 30 16:54:34 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (ceab291d-d0c3-4652-96bb-ef9c25edd434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5309ae0-517e-4e70-9d88-73b43eb7cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5309ae0-517e-4e70-9d88-73b43eb7cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798915920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33090ed2-e89f-4c12-b02a-1d955c6f1cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:35Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f605d7e-d16a-4283-a619-a9d108cee104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f605d7e-d16a-4283-a619-a9d108cee104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2bc538-970c-4217-8c77-b7c2507dbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2bc538-970c-4217-8c77-b7c2507dbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33090ed2-e89f-4c12-b02a-1d955c6f1cfa', 'volume_name': 'volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a51bfb9-bc7e-4771-947b-666824b9cff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a51bfb9-bc7e-4771-947b-666824b9cff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9674a57c-6a84-4c67-8375-4a1f66a69d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Volume 33090ed2-e89f-4c12-b02a-1d955c6f1cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa', 'volume_size': 1} Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:34 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880" returned: 0 in 0.403s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:34 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 is being set with open permissions: ugo+rw Jul 30 16:54:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:34 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 Jul 30 16:54:34 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info Jul 30 16:54:35 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info is being set with open permissions: ugo+rw Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info Jul 30 16:54:35 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.info" returned: 0 in 0.317s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1798915920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33090ed2-e89f-4c12-b02a-1d955c6f1cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:35Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Creating volume 33090ed2-e89f-4c12-b02a-1d955c6f1cfa {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:35 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:35 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa 1073741824 Jul 30 16:54:35 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f001d923-b176-4ff8-84db-9274834f0103 tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:54:36 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa 1073741824" returned: 0 in 0.538s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:36 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa Jul 30 16:54:36 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-a8b101aa-c89c-40a3-a03b-03843cfce880-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-a8b101aa-c89c-40a3-a03b-03843cfce880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-de7b688c-b2a1-4739-995b-29f984cbc4a0" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-de7b688c-b2a1-4739-995b-29f984cbc4a0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-a8b101aa-c89c-40a3-a03b-03843cfce880" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-a8b101aa-c89c-40a3-a03b-03843cfce880" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot a8b101aa-c89c-40a3-a03b-03843cfce880 of volume de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f5a97-b14f-43f8-af65-b3ddc4a46927]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:36 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa" returned: 0 in 0.374s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9674a57c-6a84-4c67-8375-4a1f66a69d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8de431-7899-479e-8d80-34b4ff15bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:36 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 Jul 30 16:54:36 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:36 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Volume volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa (33090ed2-e89f-4c12-b02a-1d955c6f1cfa): created successfully Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8de431-7899-479e-8d80-34b4ff15bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:36 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (ceab291d-d0c3-4652-96bb-ef9c25edd434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e4b91b63-0aa2-49b8-af36-7c6102405e7a tempest-ProjectReaderTests-1096573167 None] Created volume successfully. Jul 30 16:54:37 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880" returned: 0 in 0.515s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de7b688c-b2a1-4739-995b-29f984cbc4a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc9693-721a-4c55-8bfb-01847edbcedf]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:37 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 Jul 30 16:54:37 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:37 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (a03109e9-23e7-430f-a314-8e06225ccb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe15391-b085-4c9b-80d6-6081b7a5e39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0" returned: 0 in 0.493s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:37 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe15391-b085-4c9b-80d6-6081b7a5e39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220254890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5827953c-02fc-4fa9-9d0e-7c43b147d37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:38Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:37 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4f0e9d-b2ff-4ebb-b5b3-87031945c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4f0e9d-b2ff-4ebb-b5b3-87031945c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1849df3-2d41-4636-9026-a86cf18712f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1849df3-2d41-4636-9026-a86cf18712f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5827953c-02fc-4fa9-9d0e-7c43b147d37a', 'volume_name': 'volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdf32c5-7a56-4092-be79-43f2ab869ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdf32c5-7a56-4092-be79-43f2ab869ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b14520e-61df-4a7b-8b2c-4814ca3173a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:37 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Volume 5827953c-02fc-4fa9-9d0e-7c43b147d37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a', 'volume_size': 1} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220254890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5827953c-02fc-4fa9-9d0e-7c43b147d37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:38Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Creating volume 5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:37 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:37 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a 1073741824 Jul 30 16:54:37 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880" returned: 0 in 0.391s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:38 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880 Jul 30 16:54:38 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-33090ed2-e89f-4c12-b02a-1d955c6f1cfa-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Lock "cinder-33090ed2-e89f-4c12-b02a-1d955c6f1cfa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:38 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a 1073741824" returned: 0 in 0.611s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-quobyte-33090ed2-e89f-4c12-b02a-1d955c6f1cfa" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-33090ed2-e89f-4c12-b02a-1d955c6f1cfa" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:38 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7572e374-3953-4948-8e86-f6f5c1166b13]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0.a8b101aa-c89c-40a3-a03b-03843cfce880" returned: 0 in 0.383s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a Jul 30 16:54:38 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-a8b101aa-c89c-40a3-a03b-03843cfce880" released by "_delete_snapshot" :: held 1.942s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-de7b688c-b2a1-4739-995b-29f984cbc4a0" released by "delete_snapshot" :: held 1.981s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:38 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa Jul 30 16:54:38 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Created reservations ['169d4524-049b-49c8-8f1b-243c92769d73', '24e96592-6f95-49cb-adc5-41460f05eec0', '737d9feb-462f-4f46-99f0-b5bc9af2d76a', 'f48dcab8-623f-4d5f-9f7c-f3186ac4b442'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2a7ff59d-a6bd-4ef7-927a-00c138011bb3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-a8b101aa-c89c-40a3-a03b-03843cfce880-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:38 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a" returned: 0 in 0.318s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b14520e-61df-4a7b-8b2c-4814ca3173a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0618b4-9cf4-4286-929c-893e842f9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:38 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Volume volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a (5827953c-02fc-4fa9-9d0e-7c43b147d37a): created successfully Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0618b4-9cf4-4286-929c-893e842f9407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (a03109e9-23e7-430f-a314-8e06225ccb3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e7e1abdd-4289-4842-a8f3-08df10e8a743 tempest-ProjectReaderTests-1160789875 None] Created volume successfully. Jul 30 16:54:38 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa" returned: 0 in 0.438s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:38 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa Jul 30 16:54:38 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:39 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-33090ed2-e89f-4c12-b02a-1d955c6f1cfa" returned: 0 in 0.241s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-33090ed2-e89f-4c12-b02a-1d955c6f1cfa" released by "delete_volume" :: held 0.734s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Created reservations ['a72fb9b0-1f3c-4d10-a3ce-f42e9af2681d', 'd723830f-7fcb-4c6f-a780-77fc024d6ea3', '41ee705d-cdcb-4931-a7de-215a6e77db03', 'cbe147ef-609c-4268-95fc-5e2f8adf35aa'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:39 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:39 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:39 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Deleted volume successfully. Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-226d9b7b-d08d-48c5-b1bd-62dd3fb6e26b tempest-ProjectReaderTests-1096573167 None] Lock "cinder-33090ed2-e89f-4c12-b02a-1d955c6f1cfa-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-de7b688c-b2a1-4739-995b-29f984cbc4a0-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Lock "cinder-de7b688c-b2a1-4739-995b-29f984cbc4a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-de7b688c-b2a1-4739-995b-29f984cbc4a0" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-de7b688c-b2a1-4739-995b-29f984cbc4a0" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4386bd9c-05a3-4909-8f98-02449dfa228d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:40 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 Jul 30 16:54:40 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (3427c97e-7eca-4fe9-be4e-19e772edc1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4648c7c6-8a6f-49fb-a806-357e2674f156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4648c7c6-8a6f-49fb-a806-357e2674f156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047812149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:40Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea3a6df-acb5-4006-a68f-9952cc16ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea3a6df-acb5-4006-a68f-9952cc16ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654c3dcf-0a36-466c-837f-8dc6c9c2f6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654c3dcf-0a36-466c-837f-8dc6c9c2f6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273', 'volume_name': 'volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac700100-9d76-410e-9a10-4d687b975bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac700100-9d76-410e-9a10-4d687b975bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0149f71-8527-47be-8af2-7c97929ee44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:40 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Volume 4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273', 'volume_size': 1} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Creating offline snapshot 0e446422-14b3-4496-8ecf-0ae66c08aa76 of volume 5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7e7cd-4c44-4bf8-b7ce-79290820e162]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:40 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a Jul 30 16:54:40 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:40 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0" returned: 0 in 0.373s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:40 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0 Jul 30 16:54:40 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:40 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:40 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-de7b688c-b2a1-4739-995b-29f984cbc4a0" returned: 0 in 0.250s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:40 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 1G Jul 30 16:54:40 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-de7b688c-b2a1-4739-995b-29f984cbc4a0" released by "delete_volume" :: held 0.710s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Created reservations ['6c1fc9eb-9923-4653-9197-3d2e4a048219', 'b61c2704-a536-4b0a-92cc-a0b4fc1b4bb3', '69c59531-bb5e-4808-a695-b37a3fdc0c17', '125f011e-7fce-4eb4-bdd8-9be81753d844'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:40 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:40 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:41 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-515ecd95-f74b-4b52-b5e1-f3082a3a2838 tempest-ProjectMemberTests-427897876 None] Lock "cinder-de7b688c-b2a1-4739-995b-29f984cbc4a0-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:41 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 1G" returned: 0 in 0.495s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:41 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 Jul 30 16:54:41 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:41 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76" returned: 0 in 0.364s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 is being set with open permissions: ugo+rw Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:41 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 Jul 30 16:54:41 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:41 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76" returned: 0 in 0.246s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:41 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info Jul 30 16:54:41 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (fb0dfe8e-de7f-4175-a7f3-73d962593515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2816fff9-a188-4ace-a074-a0e9b1ef923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2816fff9-a188-4ace-a074-a0e9b1ef923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108669112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cb9591-c19a-426a-8a8a-c76f5d06606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:42Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf83b1c-18f5-4751-a7f8-451189574b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf83b1c-18f5-4751-a7f8-451189574b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a61dd-f07c-4aff-afab-11af7a730a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066a61dd-f07c-4aff-afab-11af7a730a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6cb9591-c19a-426a-8a8a-c76f5d06606d', 'volume_name': 'volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31da25e5-672b-4acb-99be-b25b07627c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31da25e5-672b-4acb-99be-b25b07627c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10fa467-db0f-48eb-89be-f16e9d3af604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:41 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Volume d6cb9591-c19a-426a-8a8a-c76f5d06606d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d', 'volume_size': 1} Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:41 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info" returned: 0 in 0.262s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:41 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info is being set with open permissions: ugo+rw Jul 30 16:54:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:41 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info Jul 30 16:54:41 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:42 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.info" returned: 0 in 0.231s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1047812149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:40Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Creating volume 4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:42 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:42 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 1073741824 Jul 30 16:54:42 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:42 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-138f3bcd-494c-49ca-b435-b5ecebf7e06d tempest-ProjectReaderTests-1160789875 None] Create snapshot completed successfully Jul 30 16:54:42 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 1073741824" returned: 0 in 0.498s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:42 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 Jul 30 16:54:42 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:43 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108669112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cb9591-c19a-426a-8a8a-c76f5d06606d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:42Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Creating volume d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:43 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0149f71-8527-47be-8af2-7c97929ee44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb3779-231b-42b7-a207-ec9c65da23ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:43 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d 1073741824 Jul 30 16:54:43 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Volume volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 (4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273): created successfully Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb3779-231b-42b7-a207-ec9c65da23ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (3427c97e-7eca-4fe9-be4e-19e772edc1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5f4e14ef-f74d-4fcb-b19e-105b042633de tempest-ProjectReaderTests-1096573167 None] Created volume successfully. Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-0e446422-14b3-4496-8ecf-0ae66c08aa76-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-0e446422-14b3-4496-8ecf-0ae66c08aa76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-5827953c-02fc-4fa9-9d0e-7c43b147d37a" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-5827953c-02fc-4fa9-9d0e-7c43b147d37a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-0e446422-14b3-4496-8ecf-0ae66c08aa76" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-0e446422-14b3-4496-8ecf-0ae66c08aa76" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Deleting offline snapshot 0e446422-14b3-4496-8ecf-0ae66c08aa76 of volume 5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] snapshot_file for this snap is: volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1a34a-7e7f-4ce1-82a1-29e2d465e24d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:43 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 Jul 30 16:54:43 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:43 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d 1073741824" returned: 0 in 0.562s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:43 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d Jul 30 16:54:43 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:43 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76" returned: 0 in 0.367s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff5c5ac-27fb-492c-a611-74fc6232ed87]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:43 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d" returned: 0 in 0.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10fa467-db0f-48eb-89be-f16e9d3af604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9066c18-be0f-4897-93fc-fab6abe09b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Volume volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d (d6cb9591-c19a-426a-8a8a-c76f5d06606d): created successfully Jul 30 16:54:43 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a Jul 30 16:54:43 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9066c18-be0f-4897-93fc-fab6abe09b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (fb0dfe8e-de7f-4175-a7f3-73d962593515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c84cc817-e4a5-41c9-9be8-b79b027f8d73 tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:54:44 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a" returned: 0 in 0.361s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:44 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 Jul 30 16:54:44 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Lock "cinder-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-quobyte-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01d7bd-a0ec-40c3-ac23-1136a2730ac2]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:44 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 Jul 30 16:54:44 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:44 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76" returned: 0 in 0.389s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:44 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76 Jul 30 16:54:44 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:44 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273" returned: 0 in 0.462s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:44 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273 Jul 30 16:54:44 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:44 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a.0e446422-14b3-4496-8ecf-0ae66c08aa76" returned: 0 in 0.322s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-0e446422-14b3-4496-8ecf-0ae66c08aa76" released by "_delete_snapshot" :: held 1.549s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:44 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-5827953c-02fc-4fa9-9d0e-7c43b147d37a" released by "delete_snapshot" :: held 1.584s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Creating offline snapshot 1d4dc6a2-f703-418d-b492-a4de576963e1 of volume d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Created reservations ['d5637d38-dd78-46d4-bf96-45260040401e', 'c6b5d8c9-0319-4136-8cc6-c90a4b606cae', '9232c36c-41a7-41e1-a97a-fced372eb1ef', '79268223-be13-4efb-8234-94e281d996a9'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32684f0-edd8-4a47-a05f-a82a5169a607]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Delete snapshot completed successfully. Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-58ef7331-7ddb-42f7-9018-2918431372b0 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-0e446422-14b3-4496-8ecf-0ae66c08aa76-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:45 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273" returned: 0 in 0.330s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273" released by "delete_volume" :: held 0.842s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:45 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d Jul 30 16:54:45 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Created reservations ['10f77be9-179d-4787-a93a-120e0c3cc85d', '33a4bf47-c9c0-47ce-818c-129a1c82156b', 'db55eceb-97a7-487d-a8e4-c743700f0c88', '65494948-7f95-4817-ab8f-af962cff6984'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:45 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:45 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-5827953c-02fc-4fa9-9d0e-7c43b147d37a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-5827953c-02fc-4fa9-9d0e-7c43b147d37a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:45 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d" returned: 0 in 0.581s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:45 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 1G Jul 30 16:54:45 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-5827953c-02fc-4fa9-9d0e-7c43b147d37a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-5827953c-02fc-4fa9-9d0e-7c43b147d37a" acquired by "delete_volume" :: waited 0.040s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f61397-b199-43ea-b8b4-5d3dc68d07b0]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:45 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.475s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:45 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:45 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Deleted volume successfully. Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-71f4b971-8c12-440f-b0b3-8c7498ae3d64 tempest-ProjectReaderTests-1096573167 None] Lock "cinder-4aa3d8a0-1413-4eec-8fb7-d5e2f4b4f273-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:46 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a Jul 30 16:54:46 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (21af7c58-8106-4b34-b481-c84f6488996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d6d800-0dd0-4241-bb75-d5753d551719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d6d800-0dd0-4241-bb75-d5753d551719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712311980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:46Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2fa969-ab72-4ab2-806e-14b1c2f2a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2fa969-ab72-4ab2-806e-14b1c2f2a782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11680fb9-340e-49f4-b9ea-709f6ada2bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11680fb9-340e-49f4-b9ea-709f6ada2bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806', 'volume_name': 'volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20db0896-221d-453a-824d-7f82b7b7c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20db0896-221d-453a-824d-7f82b7b7c651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ea60c5-9ce5-4119-8210-ced2630fb14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:46 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Volume 4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806', 'volume_size': 1} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 1G" returned: 0 in 0.707s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a" returned: 0 in 0.527s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 Jul 30 16:54:46 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a Jul 30 16:54:46 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-5827953c-02fc-4fa9-9d0e-7c43b147d37a" returned: 0 in 0.271s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-5827953c-02fc-4fa9-9d0e-7c43b147d37a" released by "delete_volume" :: held 0.915s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:46 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Created reservations ['47416c55-ecf0-41ff-bbd6-0dda224a4604', '5f83985c-e18f-4780-b1f2-ddf8fffc5e4f', '5f806a74-f937-412c-8c54-63df0401f156', '055a26a4-9af7-411f-8edb-e7ad33e6cc05'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1" returned: 0 in 0.368s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:46 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 is being set with open permissions: ugo+rw Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 Jul 30 16:54:46 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:46 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:46 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:47 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1" returned: 0 in 0.287s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:47 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info Jul 30 16:54:47 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:47 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Deleted volume successfully. Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8bc0426a-2e96-4bd8-a622-5bac849f4fd4 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-5827953c-02fc-4fa9-9d0e-7c43b147d37a-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:47 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:47 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info is being set with open permissions: ugo+rw Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:47 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info Jul 30 16:54:47 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:47 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.info" returned: 0 in 0.235s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712311980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:46Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Creating volume 4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:47 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:47 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 1073741824 Jul 30 16:54:47 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:47 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-0a0688ca-1bde-4fdc-93cb-f6dc6181e6c7 tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:54:48 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 1073741824" returned: 0 in 0.478s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:48 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 Jul 30 16:54:48 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-1d4dc6a2-f703-418d-b492-a4de576963e1-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Lock "cinder-1d4dc6a2-f703-418d-b492-a4de576963e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-d6cb9591-c19a-426a-8a8a-c76f5d06606d" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-d6cb9591-c19a-426a-8a8a-c76f5d06606d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-1d4dc6a2-f703-418d-b492-a4de576963e1" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-1d4dc6a2-f703-418d-b492-a4de576963e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot 1d4dc6a2-f703-418d-b492-a4de576963e1 of volume d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db59281-7f26-4782-9d8f-f84ae15ea546]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:48 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (0c45d729-cbab-4d66-a4ef-b42a2abeb2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad852688-1188-4c56-b6ad-28828c1bd7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806" returned: 0 in 0.341s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad852688-1188-4c56-b6ad-28828c1bd7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842974112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a59ada-286a-410a-a7ac-d64d6a682b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:48Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c276cb5-5869-4c17-a7d1-f6172fba74f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 Jul 30 16:54:48 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c276cb5-5869-4c17-a7d1-f6172fba74f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89233d5f-a918-4224-a70c-f520dfd95581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89233d5f-a918-4224-a70c-f520dfd95581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a59ada-286a-410a-a7ac-d64d6a682b58', 'volume_name': 'volume-68a59ada-286a-410a-a7ac-d64d6a682b58', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39093bf0-da12-4910-a806-05c2c14ec980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39093bf0-da12-4910-a806-05c2c14ec980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7252d49f-8167-4689-8d8a-68ad60f0c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Volume 68a59ada-286a-410a-a7ac-d64d6a682b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a59ada-286a-410a-a7ac-d64d6a682b58', 'volume_size': 1} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842974112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a59ada-286a-410a-a7ac-d64d6a682b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:48Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Creating volume 68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:48 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ea60c5-9ce5-4119-8210-ced2630fb14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d45688-e690-49b3-90a3-847db3d03200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:48 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 1073741824 Jul 30 16:54:48 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:48 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Volume volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 (4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806): created successfully Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d45688-e690-49b3-90a3-847db3d03200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (21af7c58-8106-4b34-b481-c84f6488996d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-aa0f6391-c035-4c91-ba47-47d338297395 tempest-ProjectReaderTests-1096573167 None] Created volume successfully. Jul 30 16:54:48 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1" returned: 0 in 0.534s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dc8ed6-c885-46b3-ad18-47f040005d39]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d Jul 30 16:54:49 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 1073741824" returned: 0 in 0.558s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 Jul 30 16:54:49 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d" returned: 0 in 0.425s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 Jul 30 16:54:49 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58" returned: 0 in 0.315s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7252d49f-8167-4689-8d8a-68ad60f0c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a59ada-286a-410a-a7ac-d64d6a682b58', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cd1a66-62cc-4c06-ba58-412bc9ca5211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:49 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Volume volume-68a59ada-286a-410a-a7ac-d64d6a682b58 (68a59ada-286a-410a-a7ac-d64d6a682b58): created successfully Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cd1a66-62cc-4c06-ba58-412bc9ca5211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (0c45d729-cbab-4d66-a4ef-b42a2abeb2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:49 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1fcb5d22-fe53-4caa-adb6-903f52b59fd4 tempest-ProjectReaderTests-1160789875 None] Created volume successfully. Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Lock "cinder-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-quobyte-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7f0b7-807f-4b66-8b03-cb701652ab0b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 Jul 30 16:54:49 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:49 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1" returned: 0 in 0.465s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:49 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1 Jul 30 16:54:49 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:50 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d.1d4dc6a2-f703-418d-b492-a4de576963e1" returned: 0 in 0.248s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:50 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806" returned: 0 in 0.424s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-1d4dc6a2-f703-418d-b492-a4de576963e1" released by "_delete_snapshot" :: held 1.823s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-d6cb9591-c19a-426a-8a8a-c76f5d06606d" released by "delete_snapshot" :: held 1.850s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:50 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806 Jul 30 16:54:50 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Created reservations ['2fd10cf5-2613-4e55-8b1f-e55a0a5c47c3', '1ec99590-b3a2-4bc6-b447-d11307e2ce3e', '2a1920d6-db8b-4ba8-85cf-f9af3610900a', '6ae7bfe2-5230-4e1e-9812-9440126bbaa5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-49a02f4a-6e7b-4d3d-90d9-5815e9350a27 tempest-ProjectMemberTests-427897876 None] Lock "cinder-1d4dc6a2-f703-418d-b492-a4de576963e1-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:50 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806" returned: 0 in 0.305s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806" released by "delete_volume" :: held 0.768s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Created reservations ['4bdcb26e-5498-40a8-a59c-6858e091dc4a', '1b03d70b-243d-48a3-bfdf-48e62840dde1', '247f574b-4b23-4cec-b866-87f09f53fe30', '738046bd-16e3-4db5-8e31-4336b8a0b4ed'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-d6cb9591-c19a-426a-8a8a-c76f5d06606d-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Lock "cinder-d6cb9591-c19a-426a-8a8a-c76f5d06606d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-d6cb9591-c19a-426a-8a8a-c76f5d06606d" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-d6cb9591-c19a-426a-8a8a-c76f5d06606d" acquired by "delete_volume" :: waited 0.035s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b978d-7298-4759-981f-5cd3af543517]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:50 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:50 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Creating offline snapshot 5aaf5f60-6617-4126-9878-b2c25163e382 of volume 68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d5af3-8e47-41d8-a796-86d0c0a2efcf]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:50 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d Jul 30 16:54:50 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:50 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 Jul 30 16:54:50 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:51 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.352s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:51 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Deleted volume successfully. Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-72fae5d7-e967-45c2-b236-d7c4595be79e tempest-ProjectReaderTests-1096573167 None] Lock "cinder-4ee8aec9-4b6f-49a6-b7c3-d4c0d0fe9806-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:51 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d" returned: 0 in 0.582s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:51 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d Jul 30 16:54:51 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:51 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58" returned: 0 in 0.537s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:51 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 1G Jul 30 16:54:51 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (4a16fc76-83d5-45e8-9b4c-2a6c62f02ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c89a253-4700-4482-b839-24f174dde701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c89a253-4700-4482-b839-24f174dde701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788394979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bb64ea-7706-4e0e-9eb1-d20aca46d845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:51Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151efa42-9057-484e-9660-a80125180d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151efa42-9057-484e-9660-a80125180d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:51 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bffe73b-96e1-4791-b734-9cf5fce95d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bffe73b-96e1-4791-b734-9cf5fce95d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5bb64ea-7706-4e0e-9eb1-d20aca46d845', 'volume_name': 'volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c473ec-f55b-4f2d-a4ac-216f7edba6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c473ec-f55b-4f2d-a4ac-216f7edba6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8079543a-802d-4320-ab85-4d7908462999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Volume f5bb64ea-7706-4e0e-9eb1-d20aca46d845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845', 'volume_size': 1} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d6cb9591-c19a-426a-8a8a-c76f5d06606d" returned: 0 in 0.346s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-d6cb9591-c19a-426a-8a8a-c76f5d06606d" released by "delete_volume" :: held 1.025s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Created reservations ['ebc846ae-a6cd-4628-919b-6daba1b6f461', '1d30918e-f894-427e-ac37-e51d60c3e151', 'a54ba61c-f723-46d0-a7ab-f3efce4d4c36', '0e743b41-d73a-436d-b010-6a5ed4e11351'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:51 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:51 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:51 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 1G" returned: 0 in 0.575s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a59ada-286a-410a-a7ac-d64d6a682b58 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:51 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a59ada-286a-410a-a7ac-d64d6a682b58 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 Jul 30 16:54:51 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.261s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-b80bb20c-a040-4215-93f3-3a5c1f48dbbc tempest-ProjectMemberTests-427897876 None] Lock "cinder-d6cb9591-c19a-426a-8a8a-c76f5d06606d-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:52 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a59ada-286a-410a-a7ac-d64d6a682b58 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382" returned: 0 in 0.310s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 is being set with open permissions: ugo+rw Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 Jul 30 16:54:52 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info Jul 30 16:54:52 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:52 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:52 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info is being set with open permissions: ugo+rw Jul 30 16:54:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:52 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info Jul 30 16:54:52 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:53 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.info" returned: 0 in 0.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788394979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5bb64ea-7706-4e0e-9eb1-d20aca46d845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048644595583433ebbe9dd1f72bb4df6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:51Z,use_quota=True,user_id='2fd16a47980044a58e95f22a29e6132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Creating volume f5bb64ea-7706-4e0e-9eb1-d20aca46d845 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:53 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:53 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 1073741824 Jul 30 16:54:53 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:53 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8c4aeb47-2825-46da-9cde-f231d26a2ea3 tempest-ProjectReaderTests-1160789875 None] Create snapshot completed successfully Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (5b885569-2836-44fc-8c0f-808790eb9826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f679f99-c906-49b8-9d82-69b8fe0cce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f679f99-c906-49b8-9d82-69b8fe0cce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448758011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:53Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b9041d-bf61-435e-a93f-2f66fae8ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b9041d-bf61-435e-a93f-2f66fae8ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f977f999-cf36-47f6-b8c3-9d0bcfd68987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f977f999-cf36-47f6-b8c3-9d0bcfd68987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec', 'volume_name': 'volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a0fed-ff9b-4a55-9210-306419fbe1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a0fed-ff9b-4a55-9210-306419fbe1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c918fda2-4258-4e03-a4d7-1d9b89af8f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Volume 75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec', 'volume_size': 1} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:53 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 1073741824" returned: 0 in 0.416s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:53 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 Jul 30 16:54:53 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:53 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845" returned: 0 in 0.246s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448758011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:53Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Creating volume 75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:53 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8079543a-802d-4320-ab85-4d7908462999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:53 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec 1073741824 Jul 30 16:54:53 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e1de03-fceb-473e-b11d-199f028a1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Volume volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 (f5bb64ea-7706-4e0e-9eb1-d20aca46d845): created successfully Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e1de03-fceb-473e-b11d-199f028a1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Flow 'volume_create_manager' (4a16fc76-83d5-45e8-9b4c-2a6c62f02ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:53 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7c1aa424-2ede-4c83-ac7e-97799c36bfa3 tempest-ProjectReaderTests-1096573167 None] Created volume successfully. Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-5aaf5f60-6617-4126-9878-b2c25163e382-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-5aaf5f60-6617-4126-9878-b2c25163e382-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-68a59ada-286a-410a-a7ac-d64d6a682b58" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-68a59ada-286a-410a-a7ac-d64d6a682b58" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-5aaf5f60-6617-4126-9878-b2c25163e382" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-5aaf5f60-6617-4126-9878-b2c25163e382" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Deleting offline snapshot 5aaf5f60-6617-4126-9878-b2c25163e382 of volume 68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] snapshot_file for this snap is: volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a73e4c-ced0-4e5e-810d-3776e8dbf050]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 Jul 30 16:54:54 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec 1073741824" returned: 0 in 0.456s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec Jul 30 16:54:54 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382" returned: 0 in 0.373s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a59ada-286a-410a-a7ac-d64d6a682b58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca33dae4-7bb0-47fa-9a93-ed7eb537394b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 Jul 30 16:54:54 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" returned: 0 in 0.239s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c918fda2-4258-4e03-a4d7-1d9b89af8f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af19476-c69b-49d3-87e9-cf8b3badf2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Volume volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec (75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec): created successfully Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af19476-c69b-49d3-87e9-cf8b3badf2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (5b885569-2836-44fc-8c0f-808790eb9826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6183a614-c974-47e0-92f9-7c202dff0f48 tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-f5bb64ea-7706-4e0e-9eb1-d20aca46d845-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Lock "cinder-f5bb64ea-7706-4e0e-9eb1-d20aca46d845-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Acquiring lock "cinder-quobyte-f5bb64ea-7706-4e0e-9eb1-d20aca46d845" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:54 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:54 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-f5bb64ea-7706-4e0e-9eb1-d20aca46d845" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5a684-269f-499d-bb2f-e857f8a9021f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58" returned: 0 in 0.400s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:54 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 Jul 30 16:54:54 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 Jul 30 16:54:54 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:54 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:54:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:54:55 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382" returned: 0 in 0.338s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845" returned: 0 in 0.387s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382 Jul 30 16:54:55 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845 Jul 30 16:54:55 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58.5aaf5f60-6617-4126-9878-b2c25163e382" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-5aaf5f60-6617-4126-9878-b2c25163e382" released by "_delete_snapshot" :: held 1.487s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-f5bb64ea-7706-4e0e-9eb1-d20aca46d845" returned: 0 in 0.305s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-68a59ada-286a-410a-a7ac-d64d6a682b58" released by "delete_snapshot" :: held 1.525s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Lock "cinder-quobyte-f5bb64ea-7706-4e0e-9eb1-d20aca46d845" released by "delete_volume" :: held 0.743s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Creating offline snapshot 522a7580-f50a-4ac9-9d22-e02b70942d6e of volume 75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6a792-2aa4-4f4c-aa00-26a2f45b9e19]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Created reservations ['7c7f1ccc-8dfe-4a2b-8793-20690d7191e8', 'b4eac8fe-345c-4101-ae82-2289c4e72d48', 'a1335ac7-0341-4730-a051-4d2bf938c109', '370955bc-400b-4a8f-a55f-fc74b00a90db'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Created reservations ['f7b73aab-0574-4893-8632-97cd8ed65ee5', '6033e8f5-4bfe-41bb-a1f8-2c2b5223f3e1', '0f2a8c52-8d22-4214-bb27-0a37deb0a41f', '41224a12-e4df-4739-9d43-5e0fc9eea318'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:55 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Delete snapshot completed successfully. Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2d1e0c15-3a35-4f2c-8282-7217290f6e92 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-5aaf5f60-6617-4126-9878-b2c25163e382-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:55 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec Jul 30 16:54:55 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:55 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:55 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.263s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:55 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:55 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Deleted volume successfully. Jul 30 16:54:55 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e 1G Jul 30 16:54:55 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-aa6e5e01-090b-4966-8a8c-10e1d3f18e8d tempest-ProjectReaderTests-1096573167 None] Lock "cinder-f5bb64ea-7706-4e0e-9eb1-d20aca46d845-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-68a59ada-286a-410a-a7ac-d64d6a682b58-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-68a59ada-286a-410a-a7ac-d64d6a682b58-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-68a59ada-286a-410a-a7ac-d64d6a682b58" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-68a59ada-286a-410a-a7ac-d64d6a682b58" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98fa302-3409-431d-8dc4-dedef7f2082e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 Jul 30 16:54:56 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e 1G" returned: 0 in 0.454s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e Jul 30 16:54:56 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58" returned: 0 in 0.382s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58 Jul 30 16:54:56 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e" returned: 0 in 0.336s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e is being set with open permissions: ugo+rw Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:56 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e Jul 30 16:54:56 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:56 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-68a59ada-286a-410a-a7ac-d64d6a682b58" returned: 0 in 0.287s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-68a59ada-286a-410a-a7ac-d64d6a682b58" released by "delete_volume" :: held 0.737s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:56 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Created reservations ['321fdc07-0201-4987-875e-1db9421c6147', 'bd4c8a9b-b260-4dd1-98fc-885e68a15c32', '171dabb6-ff2f-479b-ae04-3c8189e3b894', 'f4e871e4-6516-4375-b621-a0fd591a5fa8'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e" returned: 0 in 0.292s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info Jul 30 16:54:57 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:54:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Deleted volume successfully. Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-60d147d0-04e6-4e1a-bbf5-04f820a18c4e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-68a59ada-286a-410a-a7ac-d64d6a682b58-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:54:57 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info" returned: 0 in 0.290s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info is being set with open permissions: ugo+rw Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info Jul 30 16:54:57 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:57 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.info" returned: 0 in 0.300s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:57 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-77108637-d7cf-4ff1-886c-1a5a6c1c4452 tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (a159e5a3-b1c0-40f7-a23c-ddb096ebda2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f203f-0c4a-4600-aac4-065c746710ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f203f-0c4a-4600-aac4-065c746710ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014948183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e476292a-7808-4640-840f-56619a6e8702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:58Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a0bc29-b763-4c14-8bea-156ed8cbe929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a0bc29-b763-4c14-8bea-156ed8cbe929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfb39a6-d277-4911-acda-a30061bf6405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfb39a6-d277-4911-acda-a30061bf6405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e476292a-7808-4640-840f-56619a6e8702', 'volume_name': 'volume-e476292a-7808-4640-840f-56619a6e8702', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48292a-c1a6-48f7-8fc5-0f120a8d86df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac48292a-c1a6-48f7-8fc5-0f120a8d86df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee35f3fe-23f3-4ada-a85d-0d6c7499dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:57 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Volume e476292a-7808-4640-840f-56619a6e8702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e476292a-7808-4640-840f-56619a6e8702', 'volume_size': 1} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014948183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e476292a-7808-4640-840f-56619a6e8702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:54:58Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Creating volume e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:54:57 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:54:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:57 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 1073741824 Jul 30 16:54:57 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 1073741824" returned: 0 in 0.421s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:58 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 Jul 30 16:54:58 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:58 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee35f3fe-23f3-4ada-a85d-0d6c7499dde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e476292a-7808-4640-840f-56619a6e8702', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699163b5-dbff-4ed8-904f-bb1abd3ce6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-522a7580-f50a-4ac9-9d22-e02b70942d6e-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:58 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Volume volume-e476292a-7808-4640-840f-56619a6e8702 (e476292a-7808-4640-840f-56619a6e8702): created successfully Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699163b5-dbff-4ed8-904f-bb1abd3ce6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (a159e5a3-b1c0-40f7-a23c-ddb096ebda2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Lock "cinder-522a7580-f50a-4ac9-9d22-e02b70942d6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:58 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7673a3b8-5fd4-4f02-a217-858382e079d5 tempest-ProjectReaderTests-1160789875 None] Created volume successfully. Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-522a7580-f50a-4ac9-9d22-e02b70942d6e" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-522a7580-f50a-4ac9-9d22-e02b70942d6e" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot 522a7580-f50a-4ac9-9d22-e02b70942d6e of volume 75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf7b380-7013-4a7d-9c80-3c03ddaab594]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e Jul 30 16:54:59 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Creating offline snapshot efd7c241-3cff-41cd-a019-dee907c3f909 of volume e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa256cdd-21b7-4e7c-ba43-18b25d56fbb9]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e" returned: 0 in 0.486s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:54:59 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 Jul 30 16:54:59 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[370fe710-d922-4f99-affc-2d284d04b1be]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec Jul 30 16:54:59 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702" returned: 0 in 0.423s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 1G Jul 30 16:54:59 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:54:59 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" returned: 0 in 0.472s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:54:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:54:59 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e Jul 30 16:54:59 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 1G" returned: 0 in 0.488s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e476292a-7808-4640-840f-56619a6e8702 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e476292a-7808-4640-840f-56619a6e8702 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 Jul 30 16:55:00 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e" returned: 0 in 0.423s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e Jul 30 16:55:00 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e476292a-7808-4640-840f-56619a6e8702 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909" returned: 0 in 0.318s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 is being set with open permissions: ugo+rw Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 Jul 30 16:55:00 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec.522a7580-f50a-4ac9-9d22-e02b70942d6e" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-522a7580-f50a-4ac9-9d22-e02b70942d6e" released by "_delete_snapshot" :: held 1.784s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" released by "delete_snapshot" :: held 1.834s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Created reservations ['372fe415-9b1d-499a-a12c-f944abd31c37', '9c04b1bd-750a-4f1b-9eb7-6309834974a6', 'aa1fa672-6841-4d53-9eeb-4029409a9d8f', 'cc2960b0-4a5b-4948-a53f-4ce761a91df6'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a78ad738-ec5e-4483-bf86-2f5402d47805 tempest-ProjectMemberTests-427897876 None] Lock "cinder-522a7580-f50a-4ac9-9d22-e02b70942d6e-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:00 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909" returned: 0 in 0.265s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:00 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info Jul 30 16:55:00 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a26621a-6e18-4eb9-8c0a-0df8dfb04e73]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:01 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info" returned: 0 in 0.291s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info is being set with open permissions: ugo+rw Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:01 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info Jul 30 16:55:01 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:01 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec Jul 30 16:55:01 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:01 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.info" returned: 0 in 0.271s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:01 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" returned: 0 in 0.385s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:01 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d525e1d8-9ddc-409e-b865-c11d27d8a9d6 tempest-ProjectReaderTests-1160789875 None] Create snapshot completed successfully Jul 30 16:55:01 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec Jul 30 16:55:01 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:01 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec" released by "delete_volume" :: held 0.711s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Created reservations ['d7f891fe-4a94-4f43-85ae-7e5dc35f7dbc', '7720ee8b-1933-40e2-a986-c48db186b4bc', '58d6b9d0-71d1-4074-a418-ff324393d852', '400f584e-0356-4bf3-9ee0-1403c46a1f15'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:01 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:01 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:01 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:02 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:02 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-29fe97aa-225c-496e-b352-7c93ca8ec1f3 tempest-ProjectMemberTests-427897876 None] Lock "cinder-75ffbf31-28d3-4ea3-bbe3-5c003e04a1ec-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-efd7c241-3cff-41cd-a019-dee907c3f909-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-efd7c241-3cff-41cd-a019-dee907c3f909-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-e476292a-7808-4640-840f-56619a6e8702" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-e476292a-7808-4640-840f-56619a6e8702" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-efd7c241-3cff-41cd-a019-dee907c3f909" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-efd7c241-3cff-41cd-a019-dee907c3f909" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Deleting offline snapshot efd7c241-3cff-41cd-a019-dee907c3f909 of volume e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] snapshot_file for this snap is: volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e50c72b-a55a-42c9-9d98-68532dc48963]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:02 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 Jul 30 16:55:02 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (2acc9aec-51dd-433f-b98c-a00ac808b173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0097df8e-bf69-4898-884b-ee8bad400cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0097df8e-bf69-4898-884b-ee8bad400cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509217479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3db6fb-e297-4fc6-9ef5-91c85061bb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:03Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c6ea4e-c6b6-48a6-90e8-6565e7700eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c6ea4e-c6b6-48a6-90e8-6565e7700eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d258f-c8fa-4625-a879-13e3350d21ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d258f-c8fa-4625-a879-13e3350d21ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3db6fb-e297-4fc6-9ef5-91c85061bb29', 'volume_name': 'volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4280629a-0fc8-40b7-b2b1-e129b0f53eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4280629a-0fc8-40b7-b2b1-e129b0f53eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3223d77d-c5b5-4454-95ef-5cecc4b161bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:02 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Volume 9f3db6fb-e297-4fc6-9ef5-91c85061bb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29', 'volume_size': 1} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509217479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3db6fb-e297-4fc6-9ef5-91c85061bb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:03Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Creating volume 9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:02 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:02 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 1073741824 Jul 30 16:55:02 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:02 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909" returned: 0 in 0.445s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:02 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e476292a-7808-4640-840f-56619a6e8702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f57b0a-486f-4eee-8430-b589ba456a54]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 Jul 30 16:55:03 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:03 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 1073741824" returned: 0 in 0.510s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 Jul 30 16:55:03 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:03 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702" returned: 0 in 0.386s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 Jul 30 16:55:03 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:03 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3223d77d-c5b5-4454-95ef-5cecc4b161bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90cd7e8-c988-4027-adc4-8e11215111b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:03 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Volume volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 (9f3db6fb-e297-4fc6-9ef5-91c85061bb29): created successfully Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90cd7e8-c988-4027-adc4-8e11215111b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (2acc9aec-51dd-433f-b98c-a00ac808b173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:03 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-05604cca-433e-47c6-a852-15fe0a62e128 tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:55:03 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909" returned: 0 in 0.503s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:03 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:03 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909 Jul 30 16:55:03 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:04 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702.efd7c241-3cff-41cd-a019-dee907c3f909" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-efd7c241-3cff-41cd-a019-dee907c3f909" released by "_delete_snapshot" :: held 1.723s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-e476292a-7808-4640-840f-56619a6e8702" released by "delete_snapshot" :: held 1.764s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Created reservations ['9123c2e5-e74c-4924-9d54-ab94c81d1f0f', 'a94109fc-5a8b-4aa6-a1fc-d245f817323a', 'ef77bac7-fa0b-43c3-bf72-a13b9c692529', 'a450fa2c-8d35-40ac-a865-6d80e473bcbc'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:04 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Delete snapshot completed successfully. Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-806c1a1a-822e-4a94-bc58-03218de19fc8 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-efd7c241-3cff-41cd-a019-dee907c3f909-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-e476292a-7808-4640-840f-56619a6e8702-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-e476292a-7808-4640-840f-56619a6e8702-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-e476292a-7808-4640-840f-56619a6e8702" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-e476292a-7808-4640-840f-56619a6e8702" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e975708d-c1cb-417a-a36b-6a235154a74b]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:04 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:04 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 Jul 30 16:55:04 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Creating offline snapshot 8ac2f24c-f3d8-4af9-ba5a-3c5d255761df of volume 9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55ee38-1bc3-45db-b36c-befef3f264c6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:05 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702" returned: 0 in 0.496s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:05 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702 Jul 30 16:55:05 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:05 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 Jul 30 16:55:05 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:05 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-e476292a-7808-4640-840f-56619a6e8702" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-e476292a-7808-4640-840f-56619a6e8702" released by "delete_volume" :: held 0.892s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Created reservations ['66cdc2d1-0542-4786-b460-8aa77dc2038b', '1603c33b-17d9-46e5-96b2-d2c1c3cd17f3', '6e7115ce-4951-4315-9d89-5aec9333e8c7', 'c9e64292-1ab8-4747-b99b-4c09455bf63f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:05 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" returned: 0 in 0.501s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:05 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df 1G Jul 30 16:55:05 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:05 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:05 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:05 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:06 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.360s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:06 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Deleted volume successfully. Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-4115aaaf-d5ce-407c-9cd6-ad4f9c3da93e tempest-ProjectReaderTests-1160789875 None] Lock "cinder-e476292a-7808-4640-840f-56619a6e8702-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:06 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df 1G" returned: 0 in 0.607s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:06 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df Jul 30 16:55:06 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (c9400397-6f4a-44dd-b1fd-a580cda6eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5529347a-644a-45af-b726-38bb53ca64ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5529347a-644a-45af-b726-38bb53ca64ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139054668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9c862a-de3b-45f3-a426-27aa2dd612ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:06Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfd91dc-f82b-48ad-a67b-56535d1ae199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfd91dc-f82b-48ad-a67b-56535d1ae199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e9b144-ce46-472e-a5cd-21941b32a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e9b144-ce46-472e-a5cd-21941b32a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9c862a-de3b-45f3-a426-27aa2dd612ca', 'volume_name': 'volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd57993-6321-42c4-80d2-3c294104ed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd57993-6321-42c4-80d2-3c294104ed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b60ec0-78bf-4b90-8d5d-703dfd3b7928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:06 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Volume ac9c862a-de3b-45f3-a426-27aa2dd612ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca', 'volume_size': 1} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:06 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" returned: 0 in 0.363s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:06 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df is being set with open permissions: ugo+rw Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:06 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df Jul 30 16:55:06 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:06 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:06 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:06 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info Jul 30 16:55:06 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:07 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:07 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info is being set with open permissions: ugo+rw Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:07 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info Jul 30 16:55:07 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:07 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.info" returned: 0 in 0.325s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139054668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9c862a-de3b-45f3-a426-27aa2dd612ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:06Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Creating volume ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:07 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:07 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:07 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca 1073741824 Jul 30 16:55:07 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:07 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2364488a-f9f4-4e4f-8892-ebc432448c7f tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:55:08 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca 1073741824" returned: 0 in 0.484s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:08 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca Jul 30 16:55:08 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-8ac2f24c-f3d8-4af9-ba5a-3c5d255761df-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-8ac2f24c-f3d8-4af9-ba5a-3c5d255761df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot 8ac2f24c-f3d8-4af9-ba5a-3c5d255761df of volume 9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:08 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca" returned: 0 in 0.317s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c07370a-6a50-4249-85a3-823a144d73e3]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b60ec0-78bf-4b90-8d5d-703dfd3b7928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5257a2a7-5cd3-4fba-a8e9-ea8bcbfff3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:08 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Volume volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca (ac9c862a-de3b-45f3-a426-27aa2dd612ca): created successfully Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5257a2a7-5cd3-4fba-a8e9-ea8bcbfff3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (c9400397-6f4a-44dd-b1fd-a580cda6eb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:08 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7d5dcf9d-10f3-4caa-9761-b47ccb1bf852 tempest-ProjectReaderTests-1160789875 None] Created volume successfully. Jul 30 16:55:08 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df Jul 30 16:55:08 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:08 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" returned: 0 in 0.467s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf276b78-3fec-4f47-a18d-3be244f8a3b4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Creating offline snapshot c5d894d8-04f8-40fa-a901-e9c279cde139 of volume ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6647d6a-f2d6-4610-986a-98875443b43a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:08 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:09 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 Jul 30 16:55:09 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca Jul 30 16:55:09 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" returned: 0 in 0.530s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:09 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df Jul 30 16:55:09 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:09 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca" returned: 0 in 0.578s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:09 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:09 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 1G Jul 30 16:55:09 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" returned: 0 in 0.613s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df Jul 30 16:55:10 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 1G" returned: 0 in 0.595s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 Jul 30 16:55:10 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29.8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" returned: 0 in 0.285s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-8ac2f24c-f3d8-4af9-ba5a-3c5d255761df" released by "_delete_snapshot" :: held 2.028s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" released by "delete_snapshot" :: held 2.062s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Created reservations ['8c64658a-6393-4c20-8ab7-1a22624a357f', 'd2a75b96-00cf-41dc-8ac4-229dfee0cf34', '3f41ab50-9fc9-4e4e-ba99-6e40a4b3bd17', 'e797346f-56aa-485c-964c-007b95102050'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:10 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139" returned: 0 in 0.384s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 is being set with open permissions: ugo+rw Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-c7f44e8f-b91d-4e05-8c67-93b87d931ce6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-8ac2f24c-f3d8-4af9-ba5a-3c5d255761df-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:10 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 Jul 30 16:55:10 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:10 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:10 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:10 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info Jul 30 16:55:10 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:11 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:11 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info is being set with open permissions: ugo+rw Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:11 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info Jul 30 16:55:11 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:11 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.info" returned: 0 in 0.305s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:11 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-236a75f9-8b46-4104-a2c6-108b5a9ad3a6 tempest-ProjectReaderTests-1160789875 None] Create snapshot completed successfully Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-9f3db6fb-e297-4fc6-9ef5-91c85061bb29-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Lock "cinder-9f3db6fb-e297-4fc6-9ef5-91c85061bb29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b0448f-47b4-4ec7-a6cb-de909ca5d0c7]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:11 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:11 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 Jul 30 16:55:11 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-c5d894d8-04f8-40fa-a901-e9c279cde139-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-c5d894d8-04f8-40fa-a901-e9c279cde139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-ac9c862a-de3b-45f3-a426-27aa2dd612ca" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-ac9c862a-de3b-45f3-a426-27aa2dd612ca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-c5d894d8-04f8-40fa-a901-e9c279cde139" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-c5d894d8-04f8-40fa-a901-e9c279cde139" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Deleting offline snapshot c5d894d8-04f8-40fa-a901-e9c279cde139 of volume ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:12 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] snapshot_file for this snap is: volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" returned: 0 in 0.503s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231eee0-24bb-4c01-a519-c2eae7e9faa4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:12 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29 Jul 30 16:55:12 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 Jul 30 16:55:12 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" returned: 0 in 0.296s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-9f3db6fb-e297-4fc6-9ef5-91c85061bb29" released by "delete_volume" :: held 0.871s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Created reservations ['9a02d220-af42-47b2-b2c4-7737c8beaf61', '5a89d6f4-68c1-4d31-95de-ee3b698ab99d', 'b079040d-da98-4d4a-95f6-848619328a72', '72d9d3af-7c8c-4e35-8658-8d9d4bb56695'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:12 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139" returned: 0 in 0.392s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[2813f7f9-3836-4650-b9d6-6e98c782c503]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:12 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:12 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca Jul 30 16:55:12 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:12 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:12 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:55:12 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-6f11a134-bb5f-4969-8647-8cde4259e0ab tempest-ProjectMemberTests-427897876 None] Lock "cinder-9f3db6fb-e297-4fc6-9ef5-91c85061bb29-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:13 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca" returned: 0 in 0.504s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 Jul 30 16:55:13 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (ebcb3ee8-36cf-4ac7-9e08-3f60506670c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93121f7-0915-46a5-8d87-385926807563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93121f7-0915-46a5-8d87-385926807563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595612937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8623766-7503-4c5a-b4e5-8583fcde7cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:13Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5032095d-787b-45e9-94ec-2427fbabc056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5032095d-787b-45e9-94ec-2427fbabc056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00956727-1cc4-413d-80c0-106fdfc6b494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00956727-1cc4-413d-80c0-106fdfc6b494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8623766-7503-4c5a-b4e5-8583fcde7cc2', 'volume_name': 'volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c016b4-5cd6-46c5-acba-7f01373589fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c016b4-5cd6-46c5-acba-7f01373589fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33aac7a9-4ced-490f-9a9e-86eca04066de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:13 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Volume c8623766-7503-4c5a-b4e5-8583fcde7cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2', 'volume_size': 1} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595612937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8623766-7503-4c5a-b4e5-8583fcde7cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:13Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Creating volume c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:13 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 1073741824 Jul 30 16:55:13 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139" returned: 0 in 0.462s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:13 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139 Jul 30 16:55:13 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:13 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca.c5d894d8-04f8-40fa-a901-e9c279cde139" returned: 0 in 0.276s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-c5d894d8-04f8-40fa-a901-e9c279cde139" released by "_delete_snapshot" :: held 1.751s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-ac9c862a-de3b-45f3-a426-27aa2dd612ca" released by "delete_snapshot" :: held 1.779s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:13 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 1073741824" returned: 0 in 0.481s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Created reservations ['1ced2200-d570-4b8b-87fb-667d515d1a1c', '7994dbee-d2d9-4cd2-a5fe-3bfa969effcb', '211913cf-e114-452e-9847-30d5852dd1d3', '08755c9e-3983-4cc9-bacd-2642f7c9b05a'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:13 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 Jul 30 16:55:14 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Delete snapshot completed successfully. Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8d30b4d2-f904-4785-a38d-b6dbd8e25ce9 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-c5d894d8-04f8-40fa-a901-e9c279cde139-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-ac9c862a-de3b-45f3-a426-27aa2dd612ca-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:14 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2" returned: 0 in 0.282s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33aac7a9-4ced-490f-9a9e-86eca04066de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fb1cce-be49-4220-b915-565aaf46ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-ac9c862a-de3b-45f3-a426-27aa2dd612ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:14 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Volume volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 (c8623766-7503-4c5a-b4e5-8583fcde7cc2): created successfully Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36fb1cce-be49-4220-b915-565aaf46ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (ebcb3ee8-36cf-4ac7-9e08-3f60506670c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-ac9c862a-de3b-45f3-a426-27aa2dd612ca" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:14 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4e35b35c-46e3-46ae-b5c6-d7080cd9b9c1 tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-ac9c862a-de3b-45f3-a426-27aa2dd612ca" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7755a83-f7a1-4d6f-aed1-34225dfb38e4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca Jul 30 16:55:14 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:14 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca" returned: 0 in 0.379s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:14 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:14 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca Jul 30 16:55:14 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:15 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ac9c862a-de3b-45f3-a426-27aa2dd612ca" returned: 0 in 0.281s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-ac9c862a-de3b-45f3-a426-27aa2dd612ca" released by "delete_volume" :: held 0.721s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Created reservations ['a302b5ae-b81b-4ca2-b164-75cea1f62f30', '5c022460-8f19-4215-909d-4c3c49aebbe2', 'bbcc91eb-fe1b-4030-8fae-7b79010f9cc0', 'ba61e045-6a95-47a1-8350-a3997f176d27'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:15 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:15 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Creating offline snapshot 6f4fe23b-2c44-4249-8efb-88abb43c2374 of volume c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[024305f4-5d51-4583-ba8a-9f3131b25498]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:15 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.342s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:15 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Deleted volume successfully. Jul 30 16:55:15 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9018bfe-8e20-42e1-b2fd-8c3a2b7db7d2 tempest-ProjectReaderTests-1160789875 None] Lock "cinder-ac9c862a-de3b-45f3-a426-27aa2dd612ca-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:15 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 Jul 30 16:55:15 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:15 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2" returned: 0 in 0.465s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:16 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 1G Jul 30 16:55:16 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (4ef50508-85ba-438a-a91f-5edfcc9f4f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a985b0ec-9d2d-4da6-a99c-04252d85caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a985b0ec-9d2d-4da6-a99c-04252d85caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704646995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8670290d-f41f-429e-8152-9364499eb91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:16Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c954f8-9dfa-48f1-ba82-62b4ed02043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c954f8-9dfa-48f1-ba82-62b4ed02043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713957c3-116f-40d6-b1fd-538df6599178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713957c3-116f-40d6-b1fd-538df6599178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8670290d-f41f-429e-8152-9364499eb91a', 'volume_name': 'volume-8670290d-f41f-429e-8152-9364499eb91a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335b3fa4-10c4-487f-ad25-1ae48c03cd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335b3fa4-10c4-487f-ad25-1ae48c03cd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da15b4a-6fbf-402d-83be-67dc79620904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:16 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Volume 8670290d-f41f-429e-8152-9364499eb91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8670290d-f41f-429e-8152-9364499eb91a', 'volume_size': 1} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:16 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 1G" returned: 0 in 0.433s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:16 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 Jul 30 16:55:16 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:16 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374" returned: 0 in 0.329s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:16 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 is being set with open permissions: ugo+rw Jul 30 16:55:16 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:16 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 Jul 30 16:55:16 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:17 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374" returned: 0 in 0.252s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:17 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info Jul 30 16:55:17 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:17 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info" returned: 0 in 0.245s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:17 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info is being set with open permissions: ugo+rw Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:17 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info Jul 30 16:55:17 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:17 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.info" returned: 0 in 0.247s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.440s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-704646995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8670290d-f41f-429e-8152-9364499eb91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a679920bca8d477596a5caa1dd9d66e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:16Z,use_quota=True,user_id='9a78d91a6f804184b9baa25494c12ba1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Creating volume 8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:17 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:17 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a 1073741824 Jul 30 16:55:17 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:17 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d58c8e2b-1004-464b-8f46-6a82a1086d7e tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Flow 'volume_create_manager' (15850385-8abe-43fc-85ba-6ad595a5ce01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de5dba2-7df1-427d-b77a-47fd190f115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de5dba2-7df1-427d-b77a-47fd190f115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-289356462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab2955-0820-4c61-8155-6696fe098059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585d2096685b45c5b184bcf6c337675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:18Z,use_quota=True,user_id='2d0f78160c144465a6f16901c77d22db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb3b94-b5c5-4f5c-9680-e0ab6fd9a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb3b94-b5c5-4f5c-9680-e0ab6fd9a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfae9fb-1b85-41b4-80cb-60e4f0767ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfae9fb-1b85-41b4-80cb-60e4f0767ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ab2955-0820-4c61-8155-6696fe098059', 'volume_name': 'volume-a7ab2955-0820-4c61-8155-6696fe098059', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb70b4c-2f3b-4b15-9bfb-3cd508c69dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb70b4c-2f3b-4b15-9bfb-3cd508c69dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577359ac-3c3a-46a1-9523-87e2cdccc90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:17 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Volume a7ab2955-0820-4c61-8155-6696fe098059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ab2955-0820-4c61-8155-6696fe098059', 'volume_size': 1} Jul 30 16:55:17 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:18 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a 1073741824" returned: 0 in 0.433s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a Jul 30 16:55:18 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:18 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a" returned: 0 in 0.238s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-289356462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab2955-0820-4c61-8155-6696fe098059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585d2096685b45c5b184bcf6c337675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:18Z,use_quota=True,user_id='2d0f78160c144465a6f16901c77d22db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Creating volume a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:18 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da15b4a-6fbf-402d-83be-67dc79620904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8670290d-f41f-429e-8152-9364499eb91a', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:18 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 1073741824 Jul 30 16:55:18 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df297ac1-0245-4cd1-8e1d-ffba862cd2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:18 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Volume volume-8670290d-f41f-429e-8152-9364499eb91a (8670290d-f41f-429e-8152-9364499eb91a): created successfully Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df297ac1-0245-4cd1-8e1d-ffba862cd2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Flow 'volume_create_manager' (4ef50508-85ba-438a-a91f-5edfcc9f4f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:18 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-13539dbe-249c-4e02-b4cb-2cacfebe7173 tempest-ProjectReaderTests-1160789875 None] Created volume successfully. Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-6f4fe23b-2c44-4249-8efb-88abb43c2374-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Lock "cinder-6f4fe23b-2c44-4249-8efb-88abb43c2374-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-c8623766-7503-4c5a-b4e5-8583fcde7cc2" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-c8623766-7503-4c5a-b4e5-8583fcde7cc2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-6f4fe23b-2c44-4249-8efb-88abb43c2374" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-6f4fe23b-2c44-4249-8efb-88abb43c2374" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot 6f4fe23b-2c44-4249-8efb-88abb43c2374 of volume c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:18 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 1073741824" returned: 0 in 0.463s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6593446-1e85-48cf-959b-2c8ddb763137]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:18 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 Jul 30 16:55:18 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:18 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 Jul 30 16:55:18 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059" returned: 0 in 0.240s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577359ac-3c3a-46a1-9523-87e2cdccc90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ab2955-0820-4c61-8155-6696fe098059', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe1c337-e511-497c-a471-a749ee1da254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:19 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Volume volume-a7ab2955-0820-4c61-8155-6696fe098059 (a7ab2955-0820-4c61-8155-6696fe098059): created successfully Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe1c337-e511-497c-a471-a749ee1da254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Flow 'volume_create_manager' (15850385-8abe-43fc-85ba-6ad595a5ce01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:19 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-3b82702e-2bab-4915-ab9f-932f0c9a96e3 tempest-SnapshotDependencyTests-1073058168 None] Created volume successfully. Jul 30 16:55:19 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374" returned: 0 in 0.370s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a4f0be-6428-4057-87f2-fb1fe619ba4e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 Jul 30 16:55:19 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Creating offline snapshot d347d19b-89a1-4ff1-9c78-b1f2189d5633 of volume 8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c7e0ae-4215-4e10-aa13-ebea45e900e6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a Jul 30 16:55:19 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2" returned: 0 in 0.388s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 Jul 30 16:55:19 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:19 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a" returned: 0 in 0.398s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:19 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:19 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 1G Jul 30 16:55:19 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:20 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374" returned: 0 in 0.487s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:20 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374 Jul 30 16:55:20 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:20 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 1G" returned: 0 in 0.543s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8670290d-f41f-429e-8152-9364499eb91a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:20 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2.6f4fe23b-2c44-4249-8efb-88abb43c2374" returned: 0 in 0.286s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8670290d-f41f-429e-8152-9364499eb91a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 Jul 30 16:55:20 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-6f4fe23b-2c44-4249-8efb-88abb43c2374" released by "_delete_snapshot" :: held 1.654s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-c8623766-7503-4c5a-b4e5-8583fcde7cc2" released by "delete_snapshot" :: held 1.684s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Created reservations ['96424078-f117-4c5c-803c-de7cadb84f42', '2be1bff7-4b4d-419e-9d51-04d5edde2fa6', 'c392f07d-128a-4755-8d96-c672f01f77ae', '7fe68b64-5b72-4ed6-bc63-02ef667f9119'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:20 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-baad6fc3-ec06-4566-83f5-5361361b7a85 tempest-ProjectMemberTests-427897876 None] Lock "cinder-6f4fe23b-2c44-4249-8efb-88abb43c2374-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:20 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8670290d-f41f-429e-8152-9364499eb91a -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633" returned: 0 in 0.314s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 is being set with open permissions: ugo+rw Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:20 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 Jul 30 16:55:20 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-c8623766-7503-4c5a-b4e5-8583fcde7cc2-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Lock "cinder-c8623766-7503-4c5a-b4e5-8583fcde7cc2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:20 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-c8623766-7503-4c5a-b4e5-8583fcde7cc2" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-c8623766-7503-4c5a-b4e5-8583fcde7cc2" acquired by "delete_volume" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8e967-ed8b-4e4c-97c0-7d6e837dbfd4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:20 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:20 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info Jul 30 16:55:20 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 Jul 30 16:55:21 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info" returned: 0 in 0.267s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:21 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info is being set with open permissions: ugo+rw Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info Jul 30 16:55:21 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2" returned: 0 in 0.366s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2 Jul 30 16:55:21 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.info" returned: 0 in 0.245s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.251s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Creating offline snapshot f04a2dc2-e5f5-4275-8889-86104f0fec3c of volume a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:21 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-4827cb11-fafc-4e48-8c84-f89b47ded28d tempest-ProjectReaderTests-1160789875 None] Create snapshot completed successfully Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a0bbc-0f58-438e-b78a-170db20bd8b1]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-c8623766-7503-4c5a-b4e5-8583fcde7cc2" returned: 0 in 0.259s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-c8623766-7503-4c5a-b4e5-8583fcde7cc2" released by "delete_volume" :: held 0.690s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:21 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 Jul 30 16:55:21 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Created reservations ['2b947f9e-46ee-4c05-8ff3-f76ae23d2224', 'd24dbfe2-064b-4085-8d49-daf2c52f545e', '26946a93-ea79-4312-92e6-7970aa90d7d8', 'df879ea8-09e5-4df9-ac34-4cbd717bb1c8'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:21 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:21 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059" returned: 0 in 0.402s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:21 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:21 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c 1G Jul 30 16:55:21 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.273s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:22 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-593f83f7-8208-478f-9b20-90853e450209 tempest-ProjectMemberTests-427897876 None] Lock "cinder-c8623766-7503-4c5a-b4e5-8583fcde7cc2-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:22 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c 1G" returned: 0 in 0.461s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ab2955-0820-4c61-8155-6696fe098059 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:22 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ab2955-0820-4c61-8155-6696fe098059 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c Jul 30 16:55:22 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (14b892c3-9de5-432c-8048-7074a49bf15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befbe7a4-e2c7-44eb-8f3a-0ffe4ce49109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-d347d19b-89a1-4ff1-9c78-b1f2189d5633-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (befbe7a4-e2c7-44eb-8f3a-0ffe4ce49109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620305465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01be3bb-7632-4c98-8b73-f215bee7ab27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:22Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91a6e6b-98ec-4e46-813b-7edf4ae03fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91a6e6b-98ec-4e46-813b-7edf4ae03fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657c4373-5801-42eb-aca2-7126c544db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657c4373-5801-42eb-aca2-7126c544db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01be3bb-7632-4c98-8b73-f215bee7ab27', 'volume_name': 'volume-a01be3bb-7632-4c98-8b73-f215bee7ab27', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ebfd12-bb21-485e-bb80-3431812fd9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ebfd12-bb21-485e-bb80-3431812fd9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1437ab2-943c-4c3b-8514-388f7ca81e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:22 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Volume a01be3bb-7632-4c98-8b73-f215bee7ab27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01be3bb-7632-4c98-8b73-f215bee7ab27', 'volume_size': 1} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Lock "cinder-d347d19b-89a1-4ff1-9c78-b1f2189d5633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-8670290d-f41f-429e-8152-9364499eb91a" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-8670290d-f41f-429e-8152-9364499eb91a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-d347d19b-89a1-4ff1-9c78-b1f2189d5633" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-d347d19b-89a1-4ff1-9c78-b1f2189d5633" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Deleting offline snapshot d347d19b-89a1-4ff1-9c78-b1f2189d5633 of volume 8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] snapshot_file for this snap is: volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4115baf9-547b-4b0e-ba1a-f19ed1daac05]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:22 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ab2955-0820-4c61-8155-6696fe098059 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c" returned: 0 in 0.313s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c is being set with open permissions: ugo+rw Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:22 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c Jul 30 16:55:22 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 Jul 30 16:55:22 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:22 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c" returned: 0 in 0.245s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:22 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:22 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info Jul 30 16:55:22 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633" returned: 0 in 0.379s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8670290d-f41f-429e-8152-9364499eb91a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdfe188-b15e-47da-881b-06fce6621ce4]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a Jul 30 16:55:23 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info" returned: 0 in 0.258s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info is being set with open permissions: ugo+rw Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info Jul 30 16:55:23 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a" returned: 0 in 0.378s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 Jul 30 16:55:23 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.info" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620305465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01be3bb-7632-4c98-8b73-f215bee7ab27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:22Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Creating volume a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:23 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 1073741824 Jul 30 16:55:23 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-951f106f-27a7-414b-a0a2-1bf8f8758ba9 tempest-SnapshotDependencyTests-1073058168 None] Create snapshot completed successfully Jul 30 16:55:23 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633" returned: 0 in 0.346s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:23 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633 Jul 30 16:55:23 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:23 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:23 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 1073741824" returned: 0 in 0.480s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:24 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 Jul 30 16:55:24 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:24 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a.d347d19b-89a1-4ff1-9c78-b1f2189d5633" returned: 0 in 0.274s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-d347d19b-89a1-4ff1-9c78-b1f2189d5633" released by "_delete_snapshot" :: held 1.469s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-8670290d-f41f-429e-8152-9364499eb91a" released by "delete_snapshot" :: held 1.493s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Created reservations ['b3f3cb1a-53d0-4c3f-858c-5c3d69ce15ad', '3555ecec-4a0f-4434-acf5-dc2ae5166174', '7b18a9be-436b-4df2-912c-5dca103ed0a0', '6955424b-80bb-414e-90d0-5aba1532f01b'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Delete snapshot completed successfully. Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-725fab81-bf6f-4d5d-9900-9c228278a85c tempest-ProjectReaderTests-1160789875 None] Lock "cinder-d347d19b-89a1-4ff1-9c78-b1f2189d5633-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:24 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27" returned: 0 in 0.243s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1437ab2-943c-4c3b-8514-388f7ca81e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01be3bb-7632-4c98-8b73-f215bee7ab27', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94977ce1-acfb-488a-8a0b-dcc93f63986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:24 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Volume volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 (a01be3bb-7632-4c98-8b73-f215bee7ab27): created successfully Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94977ce1-acfb-488a-8a0b-dcc93f63986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (14b892c3-9de5-432c-8048-7074a49bf15d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:24 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-1a9e4dcf-3b3a-471f-b525-1e813d25d9b4 tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Creating offline snapshot 84cb36b4-7633-4190-ae16-d5503fd79a68 of volume a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[28807806-eb6e-4913-80a8-c56c371ca538]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-8670290d-f41f-429e-8152-9364499eb91a-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Lock "cinder-8670290d-f41f-429e-8152-9364499eb91a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Acquiring lock "cinder-quobyte-8670290d-f41f-429e-8152-9364499eb91a" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-8670290d-f41f-429e-8152-9364499eb91a" acquired by "delete_volume" :: waited 0.028s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:24 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 Jul 30 16:55:24 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[44201fb5-17e5-4c37-a694-06968fe410b6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:24 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a Jul 30 16:55:25 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Flow 'volume_create_manager' (eace2eca-32af-4873-9a11-635aa6319560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8622739-5e03-4e63-ab5b-065f52363818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8622739-5e03-4e63-ab5b-065f52363818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9403ea66-aac8-4bf2-a097-9ce60608d865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585d2096685b45c5b184bcf6c337675d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f04a2dc2-e5f5-4275-8889-86104f0fec3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:25Z,use_quota=True,user_id='2d0f78160c144465a6f16901c77d22db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbb767f-5841-4229-bc1d-ac7e5fd17d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbb767f-5841-4229-bc1d-ac7e5fd17d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:25 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84625540-a0ed-4fd6-8e5a-2761958f3c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84625540-a0ed-4fd6-8e5a-2761958f3c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9403ea66-aac8-4bf2-a097-9ce60608d865', 'volume_name': 'volume-9403ea66-aac8-4bf2-a097-9ce60608d865', 'volume_size': 1, 'snapshot_id': 'f04a2dc2-e5f5-4275-8889-86104f0fec3c'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7594c748-f087-4fa3-9016-a6ad3eb97dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7594c748-f087-4fa3-9016-a6ad3eb97dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0362797-4fa5-449b-903b-9fe804672a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:25 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Volume 9403ea66-aac8-4bf2-a097-9ce60608d865: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9403ea66-aac8-4bf2-a097-9ce60608d865', 'volume_size': 1, 'snapshot_id': 'f04a2dc2-e5f5-4275-8889-86104f0fec3c'} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27" returned: 0 in 0.474s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:25 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 1G Jul 30 16:55:25 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a" returned: 0 in 0.389s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a Jul 30 16:55:25 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-8670290d-f41f-429e-8152-9364499eb91a" returned: 0 in 0.252s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Lock "cinder-quobyte-8670290d-f41f-429e-8152-9364499eb91a" released by "delete_volume" :: held 0.730s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:25 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 1G" returned: 0 in 0.397s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 Jul 30 16:55:25 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Created reservations ['8552c694-1283-4e8f-8c8e-0f8a7cf43b65', 'da42d9a5-c031-4966-b879-b435fa15dba5', '39099fe5-e0a7-4e27-a930-ce019e988fb7', 'ab1a2cca-08c4-4263-9be3-8982058f54c2'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:25 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:25 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:25 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:25 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68" returned: 0 in 0.343s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:25 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 is being set with open permissions: ugo+rw Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:26 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 Jul 30 16:55:26 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:26 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.293s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Deleted volume successfully. Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-99c4a1f1-53cd-4c4f-8825-1106fb147dbd tempest-ProjectReaderTests-1160789875 None] Lock "cinder-8670290d-f41f-429e-8152-9364499eb91a-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:26 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68" returned: 0 in 0.252s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:26 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info Jul 30 16:55:26 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:26 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info is being set with open permissions: ugo+rw Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:26 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info Jul 30 16:55:26 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:26 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.info" returned: 0 in 0.294s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.614s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-quobyte-f04a2dc2-e5f5-4275-8889-86104f0fec3c-9403ea66-aac8-4bf2-a097-9ce60608d865" by "_create_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-f04a2dc2-e5f5-4275-8889-86104f0fec3c-9403ea66-aac8-4bf2-a097-9ce60608d865" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Creating volume 9403ea66-aac8-4bf2-a097-9ce60608d865 from snapshot f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-quobyte-9403ea66-aac8-4bf2-a097-9ce60608d865" by "_copy_volume_from_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:26 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-7563e3a2-af27-4449-85aa-bf15701fe35a tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-9403ea66-aac8-4bf2-a097-9ce60608d865" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] snapshot: f04a2dc2-e5f5-4275-8889-86104f0fec3c, volume: 9403ea66-aac8-4bf2-a097-9ce60608d865, {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:26 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd284324-71a5-44b6-89f5-3f3357ebb196]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:27 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c Jul 30 16:55:27 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:27 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c" returned: 0 in 0.405s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ab2955-0820-4c61-8155-6696fe098059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff33245-6ee1-4753-96d9-f6390f716720]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:27 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 Jul 30 16:55:27 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:27 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059" returned: 0 in 0.442s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Creating direct copy from snapshot {{(pid=88380) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG cinder.utils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Path /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 not found in is_blk_device check {{(pid=88380) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 30 16:55:27 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:27 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 Jul 30 16:55:27 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-84cb36b4-7633-4190-ae16-d5503fd79a68-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Lock "cinder-84cb36b4-7633-4190-ae16-d5503fd79a68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-a01be3bb-7632-4c98-8b73-f215bee7ab27" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-a01be3bb-7632-4c98-8b73-f215bee7ab27" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-84cb36b4-7633-4190-ae16-d5503fd79a68" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-84cb36b4-7633-4190-ae16-d5503fd79a68" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot 84cb36b4-7633-4190-ae16-d5503fd79a68 of volume a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c95169e-b971-48fb-969f-5c2c2e760b8c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:28 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 Jul 30 16:55:28 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:28 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68" returned: 0 in 0.627s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a01be3bb-7632-4c98-8b73-f215bee7ab27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2462bb1-83e3-403c-93ee-8f1bf5550e90]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:28 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:29 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 Jul 30 16:55:29 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:29 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27" returned: 0 in 0.911s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:29 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:29 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 Jul 30 16:55:29 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:30 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68" returned: 0 in 0.805s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:30 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:30 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68 Jul 30 16:55:30 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:31 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:31 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27.84cb36b4-7633-4190-ae16-d5503fd79a68" returned: 0 in 0.609s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-84cb36b4-7633-4190-ae16-d5503fd79a68" released by "_delete_snapshot" :: held 3.157s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-a01be3bb-7632-4c98-8b73-f215bee7ab27" released by "delete_snapshot" :: held 3.207s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:31 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Created reservations ['ccc7dbce-86e0-4750-8eb4-d309ef6ef7de', '40bcc6d3-9ee8-44f8-8c9f-344f92c3692c', '10138fa4-b4d2-487f-a2a0-f455bc396e03', '1b83ea92-532c-4588-814f-49891afa2c90'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:31 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:31 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-2aedfd62-546d-488c-9824-4914f82c4818 tempest-ProjectMemberTests-427897876 None] Lock "cinder-84cb36b4-7633-4190-ae16-d5503fd79a68-delete_snapshot" released by "delete_snapshot" :: held 3.506s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-a01be3bb-7632-4c98-8b73-f215bee7ab27-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Lock "cinder-a01be3bb-7632-4c98-8b73-f215bee7ab27-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:UPDATE=265,cinder:SELECT=189,cinder:DELETE=20,cinder:INSERT=63 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:DELETE=23,cinder:SELECT=189,cinder:INSERT=68,cinder:UPDATE=223 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-a01be3bb-7632-4c98-8b73-f215bee7ab27" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-a01be3bb-7632-4c98-8b73-f215bee7ab27" acquired by "delete_volume" :: waited 0.049s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffb616f-b8d5-4b63-ac86-2381b983a06d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865" returned: 0 in 5.073s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG cinder.image.image_utils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Image conversion details: src /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 {{(pid=88380) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 30 16:55:32 devstack cinder-volume[88380]: INFO cinder.image.image_utils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Converted 1024.00 MB image at 201.83 MB/s Jul 30 16:55:32 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 is being set with open permissions: ugo+rw Jul 30 16:55:32 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:32 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 Jul 30 16:55:32 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 Jul 30 16:55:33 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-9403ea66-aac8-4bf2-a097-9ce60608d865" released by "_copy_volume_from_snapshot" :: held 6.264s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-f04a2dc2-e5f5-4275-8889-86104f0fec3c-9403ea66-aac8-4bf2-a097-9ce60608d865" released by "_create_volume_from_snapshot" :: held 6.338s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.371s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:33 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27" returned: 0 in 0.363s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0362797-4fa5-449b-903b-9fe804672a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9403ea66-aac8-4bf2-a097-9ce60608d865', 'volume_size': 1, 'snapshot_id': 'f04a2dc2-e5f5-4275-8889-86104f0fec3c'}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3348d41-8b7e-47a5-862d-ff599ebe134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:33 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27 Jul 30 16:55:33 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Volume volume-9403ea66-aac8-4bf2-a097-9ce60608d865 (9403ea66-aac8-4bf2-a097-9ce60608d865): created successfully Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3348d41-8b7e-47a5-862d-ff599ebe134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Flow 'volume_create_manager' (eace2eca-32af-4873-9a11-635aa6319560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5609ae9e-c314-40ff-b802-1fe2399215d0 tempest-SnapshotDependencyTests-1073058168 None] Created volume successfully. Jul 30 16:55:33 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a01be3bb-7632-4c98-8b73-f215bee7ab27" returned: 0 in 0.237s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-a01be3bb-7632-4c98-8b73-f215bee7ab27" released by "delete_volume" :: held 0.708s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Created reservations ['e795894f-4268-4ce6-8fc8-62c018e09147', 'fa7c0062-91dc-47e9-b969-0c127d03ec76', 'bb86759c-dd38-44c5-b691-bd9b6315ad39', '85323508-b2e8-4e54-9132-f87552a07948'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:33 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:33 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:33 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.233s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:33 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:55:33 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-f85e268f-881e-4309-a71f-e9db0edce1af tempest-ProjectMemberTests-427897876 None] Lock "cinder-a01be3bb-7632-4c98-8b73-f215bee7ab27-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-f04a2dc2-e5f5-4275-8889-86104f0fec3c-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-f04a2dc2-e5f5-4275-8889-86104f0fec3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-quobyte-a7ab2955-0820-4c61-8155-6696fe098059" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-a7ab2955-0820-4c61-8155-6696fe098059" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-quobyte-f04a2dc2-e5f5-4275-8889-86104f0fec3c" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-f04a2dc2-e5f5-4275-8889-86104f0fec3c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Deleting offline snapshot f04a2dc2-e5f5-4275-8889-86104f0fec3c of volume a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] snapshot_file for this snap is: volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48737c4-8ea5-4d05-baa2-43f1ee9baa9d]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:34 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c Jul 30 16:55:34 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (a781137d-4701-4756-818d-a92a2e688dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff93c70-d66a-4d71-8918-b70bf53c81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff93c70-d66a-4d71-8918-b70bf53c81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687985454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc177a93-a8a5-4713-8816-1e4324bda69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:34Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a117629f-525f-4572-802d-282078169f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a117629f-525f-4572-802d-282078169f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0361dd04-1865-4e2e-b0a8-97b2975acab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0361dd04-1865-4e2e-b0a8-97b2975acab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc177a93-a8a5-4713-8816-1e4324bda69c', 'volume_name': 'volume-bc177a93-a8a5-4713-8816-1e4324bda69c', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28987d56-aa9e-4700-bbf6-67f873eaf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28987d56-aa9e-4700-bbf6-67f873eaf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a4342c-d843-4504-83a8-a50d8a8a0970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:34 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Volume bc177a93-a8a5-4713-8816-1e4324bda69c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc177a93-a8a5-4713-8816-1e4324bda69c', 'volume_size': 1} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687985454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc177a93-a8a5-4713-8816-1e4324bda69c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:34Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Creating volume bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:34 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c 1073741824 Jul 30 16:55:34 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:34 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c" returned: 0 in 0.461s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ab2955-0820-4c61-8155-6696fe098059(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc98456-0fa1-4b72-ab6d-1dce4570071a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:34 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 Jul 30 16:55:34 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:34 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:34 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c 1073741824" returned: 0 in 0.541s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c Jul 30 16:55:35 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c" returned: 0 in 0.284s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:35 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059" returned: 0 in 0.607s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a4342c-d843-4504-83a8-a50d8a8a0970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc177a93-a8a5-4713-8816-1e4324bda69c', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:35 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c Jul 30 16:55:35 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95b5123-36a0-4958-909f-b3dc9e95670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:35 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Volume volume-bc177a93-a8a5-4713-8816-1e4324bda69c (bc177a93-a8a5-4713-8816-1e4324bda69c): created successfully Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95b5123-36a0-4958-909f-b3dc9e95670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (a781137d-4701-4756-818d-a92a2e688dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:35 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-9577ff4c-e848-465c-8dda-46dc2a209dcc tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:55:35 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c" returned: 0 in 0.322s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:35 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c Jul 30 16:55:35 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:35 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059.f04a2dc2-e5f5-4275-8889-86104f0fec3c" returned: 0 in 0.240s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-f04a2dc2-e5f5-4275-8889-86104f0fec3c" released by "_delete_snapshot" :: held 1.743s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-a7ab2955-0820-4c61-8155-6696fe098059" released by "delete_snapshot" :: held 1.772s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:35 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Created reservations ['52de1a64-a573-47c7-8e0f-ffb6e7b367f3', 'f145f2aa-8b42-465a-a90a-7d4c97c84dee', '85f0459e-f3b0-411b-8ddb-aabea99b29f7', '8b6f29f9-df85-4c47-a7bf-a61d431afda6'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:36 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Delete snapshot completed successfully. Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a9feb852-8f48-46b2-8e93-2c6f85f909f7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-f04a2dc2-e5f5-4275-8889-86104f0fec3c-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-a7ab2955-0820-4c61-8155-6696fe098059-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-a7ab2955-0820-4c61-8155-6696fe098059-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-quobyte-a7ab2955-0820-4c61-8155-6696fe098059" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-a7ab2955-0820-4c61-8155-6696fe098059" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d9aff-41bd-40bc-bde1-32f1bb59a2da]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:36 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 Jul 30 16:55:36 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Creating offline snapshot c7aec428-75d9-484d-a77d-e733171c5304 of volume bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[f444b9b9-d8a6-4c3b-b953-4ef5d1ce8009]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:36 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:36 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c Jul 30 16:55:36 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:37 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059" returned: 0 in 0.529s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:37 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059 Jul 30 16:55:37 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:37 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c" returned: 0 in 0.472s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:37 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 1G Jul 30 16:55:37 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:37 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-a7ab2955-0820-4c61-8155-6696fe098059" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-a7ab2955-0820-4c61-8155-6696fe098059" released by "delete_volume" :: held 0.887s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Created reservations ['88a3eee3-4c18-4018-8af2-3e2de68d8e72', 'e347f97b-d86a-40ca-af1b-e8f91b523662', 'e57969fc-bc6c-4335-98d8-c76072687ee5', '576c879f-c802-4995-9f4a-5c98758b1bb5'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:37 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:37 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-9403ea66-aac8-4bf2-a097-9ce60608d865-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-9403ea66-aac8-4bf2-a097-9ce60608d865-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "cinder-quobyte-9403ea66-aac8-4bf2-a097-9ce60608d865" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-9403ea66-aac8-4bf2-a097-9ce60608d865" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c359c7c-3720-4e28-b513-c9441f4e6bdf]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:37 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.285s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:37 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Deleted volume successfully. Jul 30 16:55:37 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-e6e1bb05-3276-4621-97ad-a3afef006401 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-a7ab2955-0820-4c61-8155-6696fe098059-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 1G" returned: 0 in 0.493s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:37 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc177a93-a8a5-4713-8816-1e4324bda69c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:37 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc177a93-a8a5-4713-8816-1e4324bda69c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 Jul 30 16:55:37 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:37 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 Jul 30 16:55:37 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc177a93-a8a5-4713-8816-1e4324bda69c -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304" returned: 0 in 0.328s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 is being set with open permissions: ugo+rw Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865" returned: 0 in 0.410s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 Jul 30 16:55:38 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865 Jul 30 16:55:38 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304" returned: 0 in 0.239s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-9403ea66-aac8-4bf2-a097-9ce60608d865" returned: 0 in 0.275s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info Jul 30 16:55:38 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-quobyte-9403ea66-aac8-4bf2-a097-9ce60608d865" released by "delete_volume" :: held 0.734s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Created reservations ['78dd3613-ffa8-4796-84a9-02f5d56b6d90', 'da4a3b88-b893-4154-98ba-cbe59575c3a7', 'b8c8d822-ccb3-4c21-9d75-905b2f11e43e', 'c3d79175-0394-4030-83ca-ae0bbb45950f'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:38 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info is being set with open permissions: ugo+rw Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:38 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info Jul 30 16:55:38 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:38 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.272s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:38 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Deleted volume successfully. Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-d96661fb-1b36-4b8f-87e5-400063d883a7 tempest-SnapshotDependencyTests-1073058168 None] Lock "cinder-9403ea66-aac8-4bf2-a097-9ce60608d865-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:38 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:38 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.info" returned: 0 in 0.327s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:39 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:39 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-b7694ecd-eddc-416f-a034-cdd81b8cb8e2 tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:55:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-c7aec428-75d9-484d-a77d-e733171c5304-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-c7aec428-75d9-484d-a77d-e733171c5304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:39 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-bc177a93-a8a5-4713-8816-1e4324bda69c" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-bc177a93-a8a5-4713-8816-1e4324bda69c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-c7aec428-75d9-484d-a77d-e733171c5304" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-c7aec428-75d9-484d-a77d-e733171c5304" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot c7aec428-75d9-484d-a77d-e733171c5304 of volume bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[39125f4c-c7b2-426e-8508-1d43004c8871]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:40 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 Jul 30 16:55:40 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:40 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304" returned: 0 in 0.412s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc177a93-a8a5-4713-8816-1e4324bda69c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[95746630-5929-4f93-beef-be4f92bd0949]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:40 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c Jul 30 16:55:40 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:40 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c" returned: 0 in 0.474s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:40 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:41 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 Jul 30 16:55:41 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:41 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304" returned: 0 in 0.394s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:41 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304 Jul 30 16:55:41 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:41 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c.c7aec428-75d9-484d-a77d-e733171c5304" returned: 0 in 0.309s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-c7aec428-75d9-484d-a77d-e733171c5304" released by "_delete_snapshot" :: held 1.714s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-bc177a93-a8a5-4713-8816-1e4324bda69c" released by "delete_snapshot" :: held 1.740s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Created reservations ['8d32deab-28e0-404d-aa1a-60aa73e43894', '71f9c179-ca55-4cc9-af30-37aadaca7b6f', 'fbd3c74f-30ef-4067-b0a9-011d94f5617a', '4d9b969e-f6b7-48c6-b1de-c0e4e81b7247'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:41 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:41 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-353ebe1d-9038-478c-ad29-e85975eeafd6 tempest-ProjectMemberTests-427897876 None] Lock "cinder-c7aec428-75d9-484d-a77d-e733171c5304-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-bc177a93-a8a5-4713-8816-1e4324bda69c-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Lock "cinder-bc177a93-a8a5-4713-8816-1e4324bda69c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-bc177a93-a8a5-4713-8816-1e4324bda69c" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-bc177a93-a8a5-4713-8816-1e4324bda69c" acquired by "delete_volume" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a307661a-89fb-436d-aba6-5e514e70fd75]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:42 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c Jul 30 16:55:42 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:42 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c" returned: 0 in 0.404s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:42 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:42 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c Jul 30 16:55:42 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:43 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-bc177a93-a8a5-4713-8816-1e4324bda69c" returned: 0 in 0.372s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-bc177a93-a8a5-4713-8816-1e4324bda69c" released by "delete_volume" :: held 0.845s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Created reservations ['a358ab39-abbc-4823-8d22-fe1b04a97a66', 'dfd7f8af-8cc2-42b2-bfb0-fd94a16f6161', 'd8a9bf17-64c0-4d6a-a6f1-b5a43d1a04a9', '5c3f9163-0ae3-4bfc-b88f-e3a1b9c4e919'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:43 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:43 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:43 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:43 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-28946a33-7bd9-4605-921a-22810c59d587 tempest-ProjectMemberTests-427897876 None] Lock "cinder-bc177a93-a8a5-4713-8816-1e4324bda69c-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (ce689e6c-6fb3-400b-b054-754d4ebbe9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68e4648-15ad-465f-8680-4f9d7ea65cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68e4648-15ad-465f-8680-4f9d7ea65cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041463181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:44Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e532cc1-f4d7-463c-afcc-044f5ff91350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e532cc1-f4d7-463c-afcc-044f5ff91350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b8101e-6d50-4f92-9060-4679e7a4e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b8101e-6d50-4f92-9060-4679e7a4e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef', 'volume_name': 'volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f724c927-31ee-491c-a312-efe613772335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f724c927-31ee-491c-a312-efe613772335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8122f3f4-2d19-4431-b489-fe221f91b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:43 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Volume 0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef', 'volume_size': 1} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041463181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:44Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Creating volume 0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:43 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:43 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:43 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef 1073741824 Jul 30 16:55:43 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:44 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef 1073741824" returned: 0 in 0.524s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:44 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef Jul 30 16:55:44 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:44 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" returned: 0 in 0.279s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8122f3f4-2d19-4431-b489-fe221f91b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afe3779-b7c0-43de-8096-97edd64d2611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:44 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Volume volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef (0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef): created successfully Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afe3779-b7c0-43de-8096-97edd64d2611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:44 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (ce689e6c-6fb3-400b-b054-754d4ebbe9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:44 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-c571052a-fb04-4664-8c44-35f1b8232500 tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Creating offline snapshot 02420b1f-dd97-4040-8e97-f39eb0853a13 of volume 0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5e398-6e3b-4e24-b857-3662605b2297]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:46 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef Jul 30 16:55:46 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:46 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" returned: 0 in 0.409s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:46 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:46 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 1G Jul 30 16:55:46 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:47 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 1G" returned: 0 in 0.588s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:47 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 Jul 30 16:55:47 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:47 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13" returned: 0 in 0.317s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:47 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 is being set with open permissions: ugo+rw Jul 30 16:55:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:47 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 Jul 30 16:55:47 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:47 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:47 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:47 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info Jul 30 16:55:47 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info" returned: 0 in 0.297s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info is being set with open permissions: ugo+rw Jul 30 16:55:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:48 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info Jul 30 16:55:48 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:48 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.info" returned: 0 in 0.283s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:48 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:48 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e63be92e-a561-40e5-9bb0-e81bac26096f tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-02420b1f-dd97-4040-8e97-f39eb0853a13-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Lock "cinder-02420b1f-dd97-4040-8e97-f39eb0853a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-02420b1f-dd97-4040-8e97-f39eb0853a13" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-02420b1f-dd97-4040-8e97-f39eb0853a13" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot 02420b1f-dd97-4040-8e97-f39eb0853a13 of volume 0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5fb313-0420-4a92-8d90-33063b644423]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:49 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 Jul 30 16:55:49 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:49 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13" returned: 0 in 0.355s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca30322-4aee-4899-816c-48502a560b45]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:49 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:49 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef Jul 30 16:55:49 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:50 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" returned: 0 in 0.358s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:50 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 Jul 30 16:55:50 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:50 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13" returned: 0 in 0.344s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:50 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13 Jul 30 16:55:50 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:50 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef.02420b1f-dd97-4040-8e97-f39eb0853a13" returned: 0 in 0.251s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-02420b1f-dd97-4040-8e97-f39eb0853a13" released by "_delete_snapshot" :: held 1.419s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" released by "delete_snapshot" :: held 1.444s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Created reservations ['7aa183d3-1d95-46d6-b750-7f78665dfb62', '81c25c0e-120d-438c-8093-9d448b04adb3', 'd68ce6cb-adca-451c-aba8-3e83d2c74830', 'ac560600-d8eb-4992-8574-bc3ecc8baa80'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:50 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:50 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-5a6504b4-cbd3-41eb-b2ef-e89fd0241e72 tempest-ProjectMemberTests-427897876 None] Lock "cinder-02420b1f-dd97-4040-8e97-f39eb0853a13-delete_snapshot" released by "delete_snapshot" :: held 1.589s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Flow 'volume_create_manager' (0826c4c7-b672-466d-b577-c0758d65f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8dea07-25a0-49a7-a33d-b0f21069e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8dea07-25a0-49a7-a33d-b0f21069e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074377149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d585de48-7f87-462e-92cb-abfdc485ac33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafafb355155426b9816882de6ff2e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:51Z,use_quota=True,user_id='5ce490db145542d2b6c4cf7818515d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b39bf-cfce-4cc2-9ed2-02912753b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a1b39bf-cfce-4cc2-9ed2-02912753b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28d0d03-5480-4e74-a317-3b5e527b04b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28d0d03-5480-4e74-a317-3b5e527b04b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd585de48-7f87-462e-92cb-abfdc485ac33', 'volume_name': 'volume-d585de48-7f87-462e-92cb-abfdc485ac33', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c6e21b-1089-4d4b-ac88-5cd68935681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c6e21b-1089-4d4b-ac88-5cd68935681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c342cab-ea8d-4b03-a752-f649146a9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:51 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Volume d585de48-7f87-462e-92cb-abfdc485ac33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d585de48-7f87-462e-92cb-abfdc485ac33', 'volume_size': 1} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1074377149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d585de48-7f87-462e-92cb-abfdc485ac33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafafb355155426b9816882de6ff2e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:51Z,use_quota=True,user_id='5ce490db145542d2b6c4cf7818515d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Creating volume d585de48-7f87-462e-92cb-abfdc485ac33 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:51 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:51 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 1073741824 Jul 30 16:55:51 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Lock "cinder-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f13e30-da59-4ae8-a930-ef4ee844582a]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:51 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef Jul 30 16:55:51 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:51 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 1073741824" returned: 0 in 0.449s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:51 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 Jul 30 16:55:51 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:51 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" returned: 0 in 0.357s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:51 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef Jul 30 16:55:52 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33" returned: 0 in 0.255s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c342cab-ea8d-4b03-a752-f649146a9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d585de48-7f87-462e-92cb-abfdc485ac33', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec86501-f605-4244-b142-a9101f52b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:52 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Volume volume-d585de48-7f87-462e-92cb-abfdc485ac33 (d585de48-7f87-462e-92cb-abfdc485ac33): created successfully Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec86501-f605-4244-b142-a9101f52b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Flow 'volume_create_manager' (0826c4c7-b672-466d-b577-c0758d65f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-e02c1f2c-a8cc-4d9e-beff-ad3571bb2efc tempest-ProjectReaderTests-1930823338 None] Created volume successfully. Jul 30 16:55:52 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" returned: 0 in 0.259s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef" released by "delete_volume" :: held 0.676s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Created reservations ['28fb094a-91c7-4f2d-8a73-d92a0d34c853', '567a1b03-a442-486b-b1ee-0938ac137ba6', '97e2b6da-83e3-45cc-96de-79f36b895876', 'dde5c148-a98c-416c-ba63-818db3542ec3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:52 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Acquiring lock "cinder-d585de48-7f87-462e-92cb-abfdc485ac33-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Lock "cinder-d585de48-7f87-462e-92cb-abfdc485ac33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Acquiring lock "cinder-quobyte-d585de48-7f87-462e-92cb-abfdc485ac33" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Lock "cinder-quobyte-d585de48-7f87-462e-92cb-abfdc485ac33" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214603d-e1ff-487c-a281-cab646c5165f]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:52 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:55:52 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 Jul 30 16:55:52 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-a721675b-3c9d-4c7d-a660-f4451b03e4b1 tempest-ProjectMemberTests-427897876 None] Lock "cinder-0a2adc5d-b4f6-4dc3-86a2-952f3697f9ef-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:52 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33" returned: 0 in 0.383s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:52 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:52 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33 Jul 30 16:55:52 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (0667a70f-d391-44be-af7d-3b7e46c0b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585dc3fc-155d-4395-90ea-0cfc79a2d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585dc3fc-155d-4395-90ea-0cfc79a2d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769674757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace63f36-3bc2-4d2d-a546-d1b8f004edc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:53Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77d09c4-00fd-4f75-95ed-e755d8b6980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77d09c4-00fd-4f75-95ed-e755d8b6980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3018d18-eca4-4692-a107-4911cb0a1ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3018d18-eca4-4692-a107-4911cb0a1ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace63f36-3bc2-4d2d-a546-d1b8f004edc6', 'volume_name': 'volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e132d7-d08e-4088-b23d-fb7ce56e6fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e132d7-d08e-4088-b23d-fb7ce56e6fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa68600-3bb7-409e-be2f-303c8369ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:53 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Volume ace63f36-3bc2-4d2d-a546-d1b8f004edc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6', 'volume_size': 1} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-769674757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace63f36-3bc2-4d2d-a546-d1b8f004edc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='275e0d1ad69d4710b10f97e98c2af982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:53Z,use_quota=True,user_id='b2ccd17500ef48d8ba34b6a18f71e34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Creating volume ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:53 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-d585de48-7f87-462e-92cb-abfdc485ac33" returned: 0 in 0.289s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 1073741824 Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Lock "cinder-quobyte-d585de48-7f87-462e-92cb-abfdc485ac33" released by "delete_volume" :: held 0.711s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:53 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Created reservations ['edc2143c-54e9-4c1f-8b23-99ae2f99ca96', '3ba588c8-64cd-439f-8f63-3c06018dc743', '0bc3cb14-e2cb-4485-8f65-b7196210f5f0', '356abb99-fa74-49dc-90b3-a98599824ede'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:53 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.280s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:53 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Deleted volume successfully. Jul 30 16:55:53 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-602baf06-5095-4873-82c0-5e3e6ad2fde3 tempest-ProjectReaderTests-1930823338 None] Lock "cinder-d585de48-7f87-462e-92cb-abfdc485ac33-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 1073741824" returned: 0 in 0.460s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:53 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 Jul 30 16:55:53 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:53 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" returned: 0 in 0.256s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa68600-3bb7-409e-be2f-303c8369ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:53 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a613f47-189c-4911-960e-eec64ea70749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Volume volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 (ace63f36-3bc2-4d2d-a546-d1b8f004edc6): created successfully Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a613f47-189c-4911-960e-eec64ea70749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Flow 'volume_create_manager' (0667a70f-d391-44be-af7d-3b7e46c0b68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:54 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-84d11a01-d04f-4f20-b0b6-ae3351f54c1a tempest-ProjectMemberTests-427897876 None] Created volume successfully. Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88380) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Flow 'volume_create_manager' (10b72c9c-4520-4ed0-b3f5-8a1316cb2a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69689e8-bd87-4eba-b7d8-a92ec1e009a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69689e8-bd87-4eba-b7d8-a92ec1e009a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887177707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6590d456-fb91-4917-9f74-0221e4a1d217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafafb355155426b9816882de6ff2e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:54Z,use_quota=True,user_id='5ce490db145542d2b6c4cf7818515d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fee386-0d5d-4ff6-9f4f-b80f27132e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fee386-0d5d-4ff6-9f4f-b80f27132e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086ea8d1-e768-4a81-ae55-f6467fd6e4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086ea8d1-e768-4a81-ae55-f6467fd6e4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6590d456-fb91-4917-9f74-0221e4a1d217', 'volume_name': 'volume-6590d456-fb91-4917-9f74-0221e4a1d217', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5176dd-f706-419a-8120-d0e714ab2a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a5176dd-f706-419a-8120-d0e714ab2a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b02934d-26e9-4b14-b833-ea3d2deb73ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Volume 6590d456-fb91-4917-9f74-0221e4a1d217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6590d456-fb91-4917-9f74-0221e4a1d217', 'volume_size': 1} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-30T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1887177707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6590d456-fb91-4917-9f74-0221e4a1d217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafafb355155426b9816882de6ff2e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-30T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-30T14:55:54Z,use_quota=True,user_id='5ce490db145542d2b6c4cf7818515d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17426dbe-2d57-497f-8f5b-e9224a757947),volume_type_id=17426dbe-2d57-497f-8f5b-e9224a757947)}" {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Creating volume 6590d456-fb91-4917-9f74-0221e4a1d217 {{(pid=88380) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Selected osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 as target Quobyte volume. {{(pid=88380) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Jul 30 16:55:54 devstack cinder-volume[88380]: INFO cinder.volume.drivers.remotefs [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] casted to osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763 Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 1073741824 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:54 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 1073741824 Jul 30 16:55:54 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:54 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 1073741824" returned: 0 in 0.404s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:54 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 Jul 30 16:55:54 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:54 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:54 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:54 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217" returned: 0 in 0.254s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'} {{(pid=88380) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.612s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:54 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b02934d-26e9-4b14-b833-ea3d2deb73ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6590d456-fb91-4917-9f74-0221e4a1d217', 'volume_size': 1}' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11065bf3-4957-404e-b9b5-9fc89e322389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.268s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Creating offline snapshot ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 of volume ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_service.periodic_task [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] Running periodic task VolumeManager._thread_info {{(pid=88380) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread count: 28 {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-d1709507-72c3-4451-84ea-2d4518da2a86 None None] thread info: [<_MainThread(MainThread, started 124219325411456)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88380) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 30 16:55:54 devstack cinder-volume[88380]: INFO cinder.volume.flows.manager.create_volume [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Volume volume-6590d456-fb91-4917-9f74-0221e4a1d217 (6590d456-fb91-4917-9f74-0221e4a1d217): created successfully Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11065bf3-4957-404e-b9b5-9fc89e322389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88380) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Flow 'volume_create_manager' (10b72c9c-4520-4ed0-b3f5-8a1316cb2a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88380) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b781d9-496e-4577-8ee3-c78b0ef8ae32]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:54 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-dac62d85-de03-426a-bb60-b037103a4360 tempest-ProjectReaderTests-1930823338 None] Created volume successfully. Jul 30 16:55:55 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 Jul 30 16:55:55 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Acquiring lock "cinder-6590d456-fb91-4917-9f74-0221e4a1d217-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Lock "cinder-6590d456-fb91-4917-9f74-0221e4a1d217-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Acquiring lock "cinder-quobyte-6590d456-fb91-4917-9f74-0221e4a1d217" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Lock "cinder-quobyte-6590d456-fb91-4917-9f74-0221e4a1d217" acquired by "delete_volume" :: waited 0.021s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d864a-392b-4c7a-8c0d-2e06633378e5]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" returned: 0 in 0.382s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 1G {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 1G Jul 30 16:55:55 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 Jul 30 16:55:55 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217" returned: 0 in 0.362s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217 Jul 30 16:55:55 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 1G" returned: 0 in 0.411s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:55 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 Jul 30 16:55:55 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:55 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-6590d456-fb91-4917-9f74-0221e4a1d217" returned: 0 in 0.253s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Lock "cinder-quobyte-6590d456-fb91-4917-9f74-0221e4a1d217" released by "delete_volume" :: held 0.658s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:55 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Created reservations ['8fd5dca2-8991-422c-ba1c-026bd27a6ae2', '727caea4-48e5-4988-8a51-d66b68d856b7', 'db4b4c49-d097-4d88-9b7f-79675e390df1', 'b7fc8e1f-16f5-4848-adfd-3472056d32e3'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:55:56 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 -F qcow2 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" returned: 0 in 0.303s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 is being set with open permissions: ugo+rw Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 Jul 30 16:55:56 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.241s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:55:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Deleted volume successfully. Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-592cfec0-5923-4748-960d-7439f6852e0d tempest-ProjectReaderTests-1930823338 None] Lock "cinder-6590d456-fb91-4917-9f74-0221e4a1d217-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:56 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" returned: 0 in 0.264s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info Jul 30 16:55:56 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info" returned: 0 in 0.265s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88380]: WARNING cinder.volume.drivers.remotefs [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info is being set with open permissions: ugo+rw Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:56 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info Jul 30 16:55:56 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:56 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.info" returned: 0 in 0.259s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:56 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:55:56 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-2791c308-3b4d-449c-8b07-a102595a5037 tempest-ProjectMemberTests-427897876 None] Create snapshot completed successfully Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872-delete_snapshot" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Lock "cinder-ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" by "delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" by "_delete_snapshot" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Deleting offline snapshot ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 of volume ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] snapshot_file for this snap is: volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 {{(pid=88380) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf982a6-9e57-4473-b648-19e0372207b6]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:57 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:57 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 Jul 30 16:55:57 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:58 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" returned: 0 in 0.391s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.remotefs [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88380) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[599651e9-0e86-4c46-97a9-f2a3b56b1c5e]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:58 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 Jul 30 16:55:58 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:58 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" returned: 0 in 0.345s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:58 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 Jul 30 16:55:58 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:58 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" returned: 0 in 0.320s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:58 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:58 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872 Jul 30 16:55:58 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:55:59 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6.ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" returned: 0 in 0.249s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872" released by "_delete_snapshot" :: held 1.403s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" released by "delete_snapshot" :: held 1.429s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Created reservations ['56cfdae5-2798-4ebd-ad7d-b30429cd5110', '116deef7-a69d-4f0b-a3e2-738f1d3ffc31', 'abc9fbfb-e0ae-4042-b8c3-38de934918fa', '690b4d26-4842-468e-afa3-9bdb6a75dbee'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:55:59 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Delete snapshot completed successfully. Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-ccf74a64-8d79-450f-94d5-619b0903ce5a tempest-ProjectMemberTests-427897876 None] Lock "cinder-ec90eb0d-2b8b-4c3a-b05c-c60e21ff3872-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-ace63f36-3bc2-4d2d-a546-d1b8f004edc6-delete_volume" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Lock "cinder-ace63f36-3bc2-4d2d-a546-d1b8f004edc6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Acquiring lock "cinder-quobyte-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" by "delete_volume" {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" acquired by "delete_volume" :: waited 0.013s {{(pid=88380) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG oslo.privsep.daemon [-] privsep: reply[29533f82-632a-41d6-aa4b-320edb20df9c]: (4, 'qcow2') {{(pid=89440) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 30 16:55:59 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:55:59 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 Jul 30 16:55:59 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:00 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" returned: 0 in 0.366s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:00 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6 Jul 30 16:56:00 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:00 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b/volume-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" returned: 0 in 0.237s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Lock "cinder-quobyte-ace63f36-3bc2-4d2d-a546-d1b8f004edc6" released by "delete_volume" :: held 0.662s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG cinder.quota [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Created reservations ['e4de184f-b336-4b59-9f6a-7c3f2996d4dd', 'a2ec20ba-df02-4dad-9407-242afffdd289', 'd1e51462-226e-49e1-9bec-5413a907fb70', '316f7757-8915-4f4c-a54b-f15562620151'] {{(pid=88380) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763': None} {{(pid=88380) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG cinder.volume.drivers.quobyte [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8522440b-06be-463a-b9fe-64af11dba763'] {{(pid=88380) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.lockutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88380) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 30 16:56:00 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b Jul 30 16:56:00 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 30 16:56:00 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG oslo_concurrency.processutils [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dd65416cdaff55ad281e7d7cedf2be3b" returned: 0 in 0.248s {{(pid=88380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG cinder.manager [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Notifying Schedulers of capabilities ... {{(pid=88380) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 30 16:56:00 devstack cinder-volume[88380]: INFO cinder.volume.manager [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Deleted volume successfully. Jul 30 16:56:00 devstack cinder-volume[88380]: DEBUG cinder.coordination [None req-8afc7e45-2ce6-4cad-bcc0-f058b470ff92 tempest-ProjectMemberTests-427897876 None] Lock "cinder-ace63f36-3bc2-4d2d-a546-d1b8f004edc6-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=88380) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 30 16:56:10 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=74,cinder:UPDATE=111,cinder:DELETE=12,cinder:INSERT=27 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 30 16:56:10 devstack cinder-volume[88380]: DEBUG dbcounter [-] [88380] Writing DB stats cinder:SELECT=82,cinder:UPDATE=105,cinder:INSERT=30,cinder:DELETE=5 {{(pid=88380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}